[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:40:48 dist-test-slave-bqcl krb5kdc[9975](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:40:48 dist-test-slave-bqcl krb5kdc[9975](info): set up 2 sockets
Aug 08 17:40:48 dist-test-slave-bqcl krb5kdc[9975](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 17:40:49.988657 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:40:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:40:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:40:50.109561 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:38679
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:38679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:50.195240 10001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:50.195446 10001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:50.195477 10001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:50.196616 10001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:40:50.196658 10001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:50.196677 10001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:50.196693 10001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:40:50.196707 10001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:40:50.198376 10001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:38679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:38679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:50.198773 10001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:50.199056 10001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:50.206951 10008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:50.206984 10010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:50.206961 10012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:50.207620 10001 server_base.cc:1034] running on GCE node
I20260808 17:40:50.207927 10001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:50.208341 10001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:50.209488 10001 hybrid_clock.cc:648] HybridClock initialized: now 1786210850209450 us; error 87 us; skew 500 ppm
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:50.212119 10001 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:40:50.212751 10001 webserver.cc:460] Webserver started at http://127.9.187.254:33517/ using document root <none> and password file <none>
I20260808 17:40:50.213040 10001 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:50.213099 10001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:50.213279 10001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:50.214712 10001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "a67ee2dd81cc431baa4154d9fdb2e86c"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "9653f85450b265a9e2031af306a1b943"
server_key_iv: "e9711612ba4f12434b95d137bfe3e6e2"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.215355 10001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "a67ee2dd81cc431baa4154d9fdb2e86c"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "9653f85450b265a9e2031af306a1b943"
server_key_iv: "e9711612ba4f12434b95d137bfe3e6e2"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.217129 10001 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 17:40:50.218091 10022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:50.218395 10001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:50.218479 10001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "a67ee2dd81cc431baa4154d9fdb2e86c"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "9653f85450b265a9e2031af306a1b943"
server_key_iv: "e9711612ba4f12434b95d137bfe3e6e2"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.218534 10001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:50.234695 10001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:50.236933 10001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:50.237082 10001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:50.241772 10001 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:38679
I20260808 17:40:50.241869 10103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:38679 every 8 connection(s)
I20260808 17:40:50.242437 10001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:40:50.243912 10104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:50.244067 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 10001
I20260808 17:40:50.244160 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:40:50.244781 9967 external_mini_cluster.cc:1428] Setting key bc79d27e7a984f83c82930d92c8b9369
I20260808 17:40:50.247634 10104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c: Bootstrap starting.
I20260808 17:40:50.248662 10104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:50.249044 10104 log.cc:824] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:50.249796 10104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c: No bootstrap required, opened a new log
I20260808 17:40:50.252188 10104 raft_consensus.cc:348] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67ee2dd81cc431baa4154d9fdb2e86c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38679 } }
I20260808 17:40:50.252396 10104 raft_consensus.cc:374] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:50.252503 10104 raft_consensus.cc:729] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67ee2dd81cc431baa4154d9fdb2e86c, State: Initialized, Role: FOLLOWER
I20260808 17:40:50.252656 10104 consensus_queue.cc:260] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67ee2dd81cc431baa4154d9fdb2e86c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38679 } }
I20260808 17:40:50.252799 10104 raft_consensus.cc:388] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:40:50.252827 10104 raft_consensus.cc:482] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:40:50.252875 10104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:50.253396 10104 raft_consensus.cc:504] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67ee2dd81cc431baa4154d9fdb2e86c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38679 } }
I20260808 17:40:50.253592 10104 leader_election.cc:302] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a67ee2dd81cc431baa4154d9fdb2e86c; no voters:
I20260808 17:40:50.253786 10104 leader_election.cc:288] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:40:50.253815 10114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:50.253983 10114 raft_consensus.cc:686] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [term 1 LEADER]: Becoming Leader. State: Replica: a67ee2dd81cc431baa4154d9fdb2e86c, State: Running, Role: LEADER
I20260808 17:40:50.254197 10114 consensus_queue.cc:237] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67ee2dd81cc431baa4154d9fdb2e86c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38679 } }
I20260808 17:40:50.254346 10104 sys_catalog.cc:564] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:40:50.254706 10114 sys_catalog.cc:455] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a67ee2dd81cc431baa4154d9fdb2e86c. Latest consensus state: current_term: 1 leader_uuid: "a67ee2dd81cc431baa4154d9fdb2e86c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67ee2dd81cc431baa4154d9fdb2e86c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38679 } } }
I20260808 17:40:50.254868 10115 sys_catalog.cc:455] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a67ee2dd81cc431baa4154d9fdb2e86c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67ee2dd81cc431baa4154d9fdb2e86c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38679 } } }
I20260808 17:40:50.254943 10114 sys_catalog.cc:458] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [sys.catalog]: This master's current role is: LEADER
I20260808 17:40:50.255213 10115 sys_catalog.cc:458] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c [sys.catalog]: This master's current role is: LEADER
I20260808 17:40:50.255314 10125 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:40:50.256429 10125 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:50.259079 10125 catalog_manager.cc:1347] Generated new cluster ID: 454767a9775c417da8b405023353955b
I20260808 17:40:50.259132 10125 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:40:50.262739 10112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:50.248404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41714 (local address 127.9.187.254:38679)
0808 17:40:50.248633 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:50.248642 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:50.248667 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:40:50.249198 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:50.249205 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:50.249304 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:50.249435 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:50.251170 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.252365 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.253838 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.254505 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.254659 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:50.258804 (+ 4145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:50.258808 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:50.258808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:50.258820 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:50.260695 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.261198 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.261201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.261202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.261306 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.261551 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.261552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.261552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.261781 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:50.261905 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:50.262238 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 17:40:50.262417 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":87,"threads_started":1}
I20260808 17:40:50.272739 10125 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:40:50.273277 10125 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:40:50.276466 10125 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a67ee2dd81cc431baa4154d9fdb2e86c: Generated new TSK 0
I20260808 17:40:50.276631 10125 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:40:50.309150 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38679
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:50.443859 10144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:50.444176 10144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:50.444221 10144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:50.445971 10144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:50.446036 10144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:50.446081 10144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:40:50.448444 10144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38679
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:50.448786 10144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:50.449095 10144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:50.455554 10161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:50.455554 10158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:50.455857 10144 server_base.cc:1034] running on GCE node
W20260808 17:40:50.455947 10156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:50.456195 10144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:50.456489 10144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:50.457674 10144 hybrid_clock.cc:648] HybridClock initialized: now 1786210850457653 us; error 34 us; skew 500 ppm
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:50.460726 10144 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:40:50.461114 10144 webserver.cc:460] Webserver started at http://127.9.187.193:32849/ using document root <none> and password file <none>
I20260808 17:40:50.461325 10144 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:50.461374 10144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:50.461503 10144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:50.462585 10144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "a684644e8a59403da46ce016a2e74205"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "6b68704ec16556d69f2fc6a9e885dbef"
server_key_iv: "07af9455884633ccb419e21233964bdd"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.462932 10144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "a684644e8a59403da46ce016a2e74205"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "6b68704ec16556d69f2fc6a9e885dbef"
server_key_iv: "07af9455884633ccb419e21233964bdd"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.464244 10144 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:50.464998 10176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:50.465173 10144 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:40:50.465276 10144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "a684644e8a59403da46ce016a2e74205"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "6b68704ec16556d69f2fc6a9e885dbef"
server_key_iv: "07af9455884633ccb419e21233964bdd"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.465346 10144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:50.485910 10144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:50.488503 10144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:50.488655 10144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:50.488994 10144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:40:50.489454 10144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:50.489538 10144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:50.489576 10144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:50.489598 10144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:50.498373 10144 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:40919
I20260808 17:40:50.498508 10361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:40919 every 8 connection(s)
I20260808 17:40:50.498751 10144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:50.505715 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 10144
I20260808 17:40:50.505815 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:40:50.505980 9967 external_mini_cluster.cc:1428] Setting key 41425a64eb4f7cfcb505ec83c2aff1c5
I20260808 17:40:50.508535 10112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:50.499730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:41181 (local address 127.9.187.254:38679)
0808 17:40:50.499788 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:50.499790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:50.500032 (+ 242us) server_negotiation.cc:407] Connection header received
0808 17:40:50.500524 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:50.500525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:50.500535 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:50.500581 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:50.501647 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.502185 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.503095 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.503307 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.503357 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:50.505619 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:50.505621 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:50.505622 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:50.505630 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:50.507110 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.507575 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.507576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.507576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.507631 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.507893 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.507893 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.507894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.507989 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:50.508036 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:50.508377 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 17:40:50.508468 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:40:50.508800 10364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:50.499677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38679 (local address 127.9.187.193:41181)
0808 17:40:50.499920 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:50.499959 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:50.500438 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:50.500646 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:50.500649 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:50.501367 (+ 718us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:50.501569 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:50.501574 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.502248 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.502249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:50.503029 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:50.503032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.503366 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.503367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:50.503465 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:50.503983 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:50.503991 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:50.505521 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:50.507187 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:50.507196 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:50.507198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:50.507500 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:50.507696 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:50.507697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:50.507697 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:50.507835 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:50.508042 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:50.508049 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:50.508208 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 17:40:50.508325 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 17:40:50.508487 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":168,"threads_started":1}
I20260808 17:40:50.509392 10362 heartbeater.cc:347] Connected to a master server at 127.9.187.254:38679
I20260808 17:40:50.509481 10362 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:50.509660 10362 heartbeater.cc:511] Master 127.9.187.254:38679 requested a full tablet report, sending...
I20260808 17:40:50.510529 10045 ts_manager.cc:194] Registered new tserver with Master: a684644e8a59403da46ce016a2e74205 (127.9.187.193:40919)
I20260808 17:40:50.511276 10045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:41181
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:40:50.532485 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38679
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:50.626106 10368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:50.626341 10368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:50.626364 10368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:50.627511 10368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:50.627554 10368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:50.627583 10368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:40:50.629084 10368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38679
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:50.629262 10368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:50.629436 10368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:50.634244 10379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:50.634336 10368 server_base.cc:1034] running on GCE node
W20260808 17:40:50.634290 10377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:50.634410 10374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:50.634692 10368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:50.634938 10368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:50.636087 10368 hybrid_clock.cc:648] HybridClock initialized: now 1786210850636066 us; error 33 us; skew 500 ppm
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:50.638685 10368 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:40:50.639091 10368 webserver.cc:460] Webserver started at http://127.9.187.194:42711/ using document root <none> and password file <none>
I20260808 17:40:50.639261 10368 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:50.639300 10368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:50.639391 10368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:50.640429 10368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "f5dc3a4965ea456886c1686d09b41bfa"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "6677175d0d9b1973f2ac05a7f0a4fc6f"
server_key_iv: "cec54e631c35c2e1cd3ebf53270ccc02"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.640775 10368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "f5dc3a4965ea456886c1686d09b41bfa"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "6677175d0d9b1973f2ac05a7f0a4fc6f"
server_key_iv: "cec54e631c35c2e1cd3ebf53270ccc02"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.642357 10368 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:40:50.643078 10389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:50.643258 10368 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:50.643342 10368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "f5dc3a4965ea456886c1686d09b41bfa"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "6677175d0d9b1973f2ac05a7f0a4fc6f"
server_key_iv: "cec54e631c35c2e1cd3ebf53270ccc02"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.643393 10368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:50.702450 10368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:50.704783 10368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:50.704900 10368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:50.705204 10368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:40:50.705510 10368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:50.705546 10368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:50.705587 10368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:50.705606 10368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:50.714558 10368 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:40337
I20260808 17:40:50.714614 10581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:40337 every 8 connection(s)
I20260808 17:40:50.714939 10368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:40:50.717751 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 10368
I20260808 17:40:50.717850 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:40:50.718008 9967 external_mini_cluster.cc:1428] Setting key 4c5d3d7727b13359d8862f8dda8ed645
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:50.724843 10112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:50.715713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:56523 (local address 127.9.187.254:38679)
0808 17:40:50.715757 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:50.715759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:50.715952 (+ 193us) server_negotiation.cc:407] Connection header received
0808 17:40:50.716418 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:50.716419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:50.716430 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:50.716464 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:50.717412 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.718115 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.719204 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.719466 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.719536 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:50.722202 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:50.722204 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:50.722204 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:50.722212 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:50.723480 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.723936 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.723937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.723937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.724002 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.724227 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.724228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.724229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.724345 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:50.724405 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:50.724664 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 17:40:50.724752 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:40:50.725020 10587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:50.715660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38679 (local address 127.9.187.194:56523)
0808 17:40:50.715836 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:50.715873 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:50.716329 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:50.716529 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:50.716532 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:50.717096 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:50.717344 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:50.717350 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.718233 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.718234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:50.719108 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:50.719111 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.719562 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.719563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:50.719809 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:50.720472 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:50.720483 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:50.722080 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:50.723554 (+ 1474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:50.723562 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:50.723565 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:50.723868 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:50.724057 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:50.724058 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:50.724058 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:50.724168 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:50.724400 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:50.724407 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:50.724544 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 17:40:50.724634 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 17:40:50.724802 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":96,"threads_started":1}
I20260808 17:40:50.725442 10582 heartbeater.cc:347] Connected to a master server at 127.9.187.254:38679
I20260808 17:40:50.725530 10582 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:50.725704 10582 heartbeater.cc:511] Master 127.9.187.254:38679 requested a full tablet report, sending...
I20260808 17:40:50.726092 10045 ts_manager.cc:194] Registered new tserver with Master: f5dc3a4965ea456886c1686d09b41bfa (127.9.187.194:40337)
I20260808 17:40:50.726472 10045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:56523
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:40:50.744153 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38679
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:50.837505 10590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:50.837707 10590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:50.837728 10590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:50.838862 10590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:50.838904 10590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:50.838929 10590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:40:50.840492 10590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38679
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:50.840677 10590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:50.840849 10590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:50.846293 10605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:50.846293 10601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:50.846273 10590 server_base.cc:1034] running on GCE node
W20260808 17:40:50.846349 10600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:50.846688 10590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:50.846920 10590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:50.848037 10590 hybrid_clock.cc:648] HybridClock initialized: now 1786210850848014 us; error 42 us; skew 500 ppm
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:50.850620 10590 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:40:50.851028 10590 webserver.cc:460] Webserver started at http://127.9.187.195:45393/ using document root <none> and password file <none>
I20260808 17:40:50.851217 10590 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:50.851265 10590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:50.851392 10590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:50.852468 10590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "5e7368c08ee84d34acd10356589d2102"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "af45766e57d5abb99e5c84857c9cac3b"
server_key_iv: "387ba40dd232dc5e8218a8a4ae27e9f0"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.852851 10590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "5e7368c08ee84d34acd10356589d2102"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "af45766e57d5abb99e5c84857c9cac3b"
server_key_iv: "387ba40dd232dc5e8218a8a4ae27e9f0"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.854326 10590 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:40:50.855068 10614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:50.855224 10590 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:50.855311 10590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "5e7368c08ee84d34acd10356589d2102"
format_stamp: "Formatted at 2026-08-08 17:40:50 on dist-test-slave-bqcl"
server_key: "af45766e57d5abb99e5c84857c9cac3b"
server_key_iv: "387ba40dd232dc5e8218a8a4ae27e9f0"
server_key_version: "encryptionkey@0"
I20260808 17:40:50.855369 10590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:50.867786 10590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:50.869751 10590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:50.869910 10590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:50.870250 10590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:40:50.870573 10590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:50.870610 10590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:50.870637 10590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:50.870653 10590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:50.879199 10590 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:44585
I20260808 17:40:50.879257 10822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:44585 every 8 connection(s)
I20260808 17:40:50.879566 10590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:50.888294 10112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:50.880354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:46709 (local address 127.9.187.254:38679)
0808 17:40:50.880433 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:50.880436 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:50.880757 (+ 321us) server_negotiation.cc:407] Connection header received
0808 17:40:50.881449 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:50.881450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:50.881460 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:50.881509 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:50.882408 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.882898 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.883809 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.884014 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.884071 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:50.886112 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:50.886113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:50.886113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:50.886137 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:50.887203 (+ 1066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.887627 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.887628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.887628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.887672 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.887841 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.887842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.887842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.887934 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:50.887976 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:50.888170 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 17:40:50.888221 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 17:40:50.888491 10826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:50.880325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38679 (local address 127.9.187.195:46709)
0808 17:40:50.880626 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:50.880661 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:50.881366 (+ 705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:50.881563 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:50.881566 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:50.882115 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:50.882340 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:50.882345 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.882965 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.882965 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:50.883750 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:50.883752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.884078 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.884079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:50.884182 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:50.884628 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:50.884636 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:50.886030 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:50.887330 (+ 1300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:50.887336 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:50.887338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:50.887563 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:50.887713 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:50.887714 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:50.887714 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:50.887801 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:50.887974 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:50.887977 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:50.888079 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 17:40:50.888153 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 17:40:50.888263 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":172,"threads_started":1}
I20260808 17:40:50.888886 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 10590
I20260808 17:40:50.888965 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:40:50.888964 10823 heartbeater.cc:347] Connected to a master server at 127.9.187.254:38679
I20260808 17:40:50.889062 10823 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:50.889109 9967 external_mini_cluster.cc:1428] Setting key 856f5c447dff8193b476aeaf56b68611
I20260808 17:40:50.889245 10823 heartbeater.cc:511] Master 127.9.187.254:38679 requested a full tablet report, sending...
I20260808 17:40:50.889552 10045 ts_manager.cc:194] Registered new tserver with Master: 5e7368c08ee84d34acd10356589d2102 (127.9.187.195:44585)
I20260808 17:40:50.889902 10045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:46709
I20260808 17:40:50.890236 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.187.193@KRBTEST.COM
I20260808 17:40:50.914047 10835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:50.906621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47088 (local address 127.9.187.193:40919)
0808 17:40:50.906830 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:50.906834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:50.906844 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:40:50.906870 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:50.906872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:50.906885 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:50.906957 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:50.907543 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.908458 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.909156 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.909514 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.909609 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:50.911662 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:50.911669 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:50.911669 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:50.911675 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:50.912926 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.913279 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.913282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.913282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.913351 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.913517 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.913525 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.913525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.913653 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:50.913794 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:50.913866 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 17:40:50.913940 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":73,"threads_started":1}
W20260808 17:40:50.914501 10223 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47088
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 17:40:50 dist-test-slave-bqcl krb5kdc[9975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.193@KRBTEST.COM
I20260808 17:40:50.936406 10835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:50.930368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47096 (local address 127.9.187.193:40919)
0808 17:40:50.930433 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:50.930435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:50.930495 (+ 60us) server_negotiation.cc:407] Connection header received
0808 17:40:50.930566 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:50.930567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:50.930576 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:50.930628 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:50.931118 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.931606 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.932269 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:50.932464 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:50.932515 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:50.934410 (+ 1895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:50.934411 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:50.934412 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:50.934417 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:50.935680 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.935925 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.935926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.935926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.935969 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:50.936083 (+ 114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:50.936084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:50.936084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:50.936157 (+ 73us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:50.936234 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:50.936289 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 17:40:50.936343 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 17:40:50.937022 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 10144
I20260808 17:40:50.952301 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 10368
I20260808 17:40:50.963267 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 10590
I20260808 17:40:50.968539 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 10001
2026-08-08T17:40:50Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2222 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:40:51 dist-test-slave-bqcl krb5kdc[10855](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:40:51 dist-test-slave-bqcl krb5kdc[10855](info): set up 2 sockets
Aug 08 17:40:51 dist-test-slave-bqcl krb5kdc[10855](info): commencing operation
krb5kdc: starting...
W20260808 17:40:52.129854 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:40:52 dist-test-slave-bqcl krb5kdc[10855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:40:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:40:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:40:52.242743 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33393
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:41999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:33393
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:52.322045 10873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:52.322255 10873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:52.322275 10873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:52.323328 10873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:40:52.323360 10873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:52.323374 10873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:52.323385 10873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:40:52.323397 10873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:40:52.324777 10873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:41999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:33393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:52.324961 10873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:52.325124 10873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:52.329773 10882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:52.329838 10873 server_base.cc:1034] running on GCE node
W20260808 17:40:52.329795 10880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:52.329783 10884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:52.330286 10873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:52.330547 10873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:52.331673 10873 hybrid_clock.cc:648] HybridClock initialized: now 1786210852331661 us; error 28 us; skew 500 ppm
Aug 08 17:40:52 dist-test-slave-bqcl krb5kdc[10855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:52.333935 10873 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:40:52.334380 10873 webserver.cc:460] Webserver started at http://127.9.187.254:38085/ using document root <none> and password file <none>
I20260808 17:40:52.334594 10873 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:52.334635 10873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:52.334758 10873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:52.335723 10873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "7ed60384f42142789c0a63b51f628413"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "339d8df3069dc382320505039d83cb7f"
server_key_iv: "3e880c22e6d340e6a46ff0391888a6a8"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.336030 10873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "7ed60384f42142789c0a63b51f628413"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "339d8df3069dc382320505039d83cb7f"
server_key_iv: "3e880c22e6d340e6a46ff0391888a6a8"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.337221 10873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:40:52.337843 10898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.337990 10873 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.338069 10873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "7ed60384f42142789c0a63b51f628413"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "339d8df3069dc382320505039d83cb7f"
server_key_iv: "3e880c22e6d340e6a46ff0391888a6a8"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.338167 10873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:52.364588 10873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:52.366382 10873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:52.366516 10873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:52.370358 10873 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:33393
I20260808 17:40:52.370404 10984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:33393 every 8 connection(s)
I20260808 17:40:52.370734 10873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:40:52.371551 10986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:52.373747 10986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413: Bootstrap starting.
I20260808 17:40:52.374292 10986 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:52.374536 10986 log.cc:824] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:52.375149 10986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413: No bootstrap required, opened a new log
I20260808 17:40:52.376665 10986 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed60384f42142789c0a63b51f628413" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33393 } }
I20260808 17:40:52.376847 10986 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:52.376893 10986 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ed60384f42142789c0a63b51f628413, State: Initialized, Role: FOLLOWER
I20260808 17:40:52.376916 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 10873
I20260808 17:40:52.376995 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:40:52.377039 10986 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed60384f42142789c0a63b51f628413" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33393 } }
I20260808 17:40:52.377120 10986 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:40:52.377154 10986 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:40:52.377164 9967 external_mini_cluster.cc:1428] Setting key 19b7a7d92cb7e9a8182f2f29b7a9e155
I20260808 17:40:52.377202 10986 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:52.377837 10986 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed60384f42142789c0a63b51f628413" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33393 } }
I20260808 17:40:52.377930 10986 leader_election.cc:302] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ed60384f42142789c0a63b51f628413; no voters:
I20260808 17:40:52.378080 10986 leader_election.cc:288] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:40:52.378157 10994 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:52.378350 10986 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:40:52.378386 10994 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [term 1 LEADER]: Becoming Leader. State: Replica: 7ed60384f42142789c0a63b51f628413, State: Running, Role: LEADER
I20260808 17:40:52.378574 10994 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed60384f42142789c0a63b51f628413" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33393 } }
I20260808 17:40:52.378976 10996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ed60384f42142789c0a63b51f628413" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed60384f42142789c0a63b51f628413" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33393 } } }
I20260808 17:40:52.379048 10996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [sys.catalog]: This master's current role is: LEADER
I20260808 17:40:52.379268 10997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ed60384f42142789c0a63b51f628413. Latest consensus state: current_term: 1 leader_uuid: "7ed60384f42142789c0a63b51f628413" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed60384f42142789c0a63b51f628413" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33393 } } }
I20260808 17:40:52.379585 10997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413 [sys.catalog]: This master's current role is: LEADER
I20260808 17:40:52.379751 11009 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:40:52.381279 11009 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:40:52.382822 11009 catalog_manager.cc:1347] Generated new cluster ID: 685b0e483599460cbafd0a4b45c2d81d
I20260808 17:40:52.382906 11009 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:40:52 dist-test-slave-bqcl krb5kdc[10855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:52.389142 10995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.378042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40526 (local address 127.9.187.254:33393)
0808 17:40:52.378226 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:52.378236 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:52.378270 (+ 34us) server_negotiation.cc:407] Connection header received
0808 17:40:52.378389 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:52.378396 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:52.378452 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:52.378638 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:52.379403 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.380548 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.381525 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.382162 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.382265 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.384986 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:52.384990 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:52.384990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:52.385001 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:52.387498 (+ 2497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:52.387936 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:52.387939 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:52.387939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:52.388047 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:52.388254 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:52.388255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:52.388255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:52.388535 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:52.388684 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:52.388804 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 17:40:52.388928 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":88,"threads_started":1}
I20260808 17:40:52.403702 11009 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:40:52.404224 11009 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:40:52.409870 11009 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ed60384f42142789c0a63b51f628413: Generated new TSK 0
I20260808 17:40:52.410087 11009 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:40:52.440608 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33393
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:41999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:52.521252 11025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:52.521453 11025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:52.521474 11025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:52.522593 11025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:52.522632 11025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:52.522660 11025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:40:52.524098 11025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:41999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33393
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:52.524379 11025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:52.524641 11025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:52.529371 11033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:52.529428 11035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:52.529484 11025 server_base.cc:1034] running on GCE node
W20260808 17:40:52.529371 11032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:52.529832 11025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:52.530059 11025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:52.531201 11025 hybrid_clock.cc:648] HybridClock initialized: now 1786210852531192 us; error 48 us; skew 500 ppm
Aug 08 17:40:52 dist-test-slave-bqcl krb5kdc[10855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:52.533658 11025 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:40:52.534049 11025 webserver.cc:460] Webserver started at http://127.9.187.193:43927/ using document root <none> and password file <none>
I20260808 17:40:52.534267 11025 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:52.534317 11025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:52.534438 11025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:52.535470 11025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "5d0457fb411247bc9411edc9a08b0628"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "f99fa46930da2b756a6afc6116be7bee"
server_key_iv: "b8321de8c6ee1e264f58638c215e26fa"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.535786 11025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "5d0457fb411247bc9411edc9a08b0628"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "f99fa46930da2b756a6afc6116be7bee"
server_key_iv: "b8321de8c6ee1e264f58638c215e26fa"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.536986 11025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:40:52.537612 11046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.537766 11025 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:40:52.537848 11025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "5d0457fb411247bc9411edc9a08b0628"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "f99fa46930da2b756a6afc6116be7bee"
server_key_iv: "b8321de8c6ee1e264f58638c215e26fa"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.537909 11025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:52.551366 11025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:52.553104 11025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:52.553244 11025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:52.553442 11025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:40:52.553725 11025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:52.553757 11025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.553784 11025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:52.553802 11025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.559118 11025 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:38523
I20260808 17:40:52.559182 11214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:38523 every 8 connection(s)
I20260808 17:40:52.559465 11025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:40:52 dist-test-slave-bqcl krb5kdc[10855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:52.565882 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 11025
I20260808 17:40:52.565987 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:40:52.566224 9967 external_mini_cluster.cc:1428] Setting key d3b58e431af0015f4040d64b3c9451c4
I20260808 17:40:52.568747 10995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.560138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:52801 (local address 127.9.187.254:33393)
0808 17:40:52.560184 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:52.560186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:52.560363 (+ 177us) server_negotiation.cc:407] Connection header received
0808 17:40:52.561360 (+ 997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:52.561361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:52.561373 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:52.561440 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:52.562003 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.562572 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.563523 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.563800 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.563855 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.565783 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:52.565785 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:52.565785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:52.565794 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:52.567460 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:52.567845 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:52.567847 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:52.567847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:52.567917 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:52.568120 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:52.568121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:52.568121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:52.568253 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:52.568326 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:52.568556 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 17:40:52.568647 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:40:52.568908 11217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.560099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33393 (local address 127.9.187.193:52801)
0808 17:40:52.560254 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:52.560295 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:52.561274 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:52.561497 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:52.561500 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:52.561738 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:52.561917 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.561921 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.562653 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.562654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.563436 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.563438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.563885 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.563886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.563988 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.564379 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:52.564387 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:52.565676 (+ 1289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:52.567558 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:52.567564 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:52.567566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:52.567780 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:52.567978 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:52.567978 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:52.567979 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:52.568066 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:52.568313 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:52.568316 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:52.568423 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 17:40:52.568522 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 17:40:52.568692 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":64,"threads_started":1}
I20260808 17:40:52.569474 11215 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33393
I20260808 17:40:52.569593 11215 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:52.569773 11215 heartbeater.cc:511] Master 127.9.187.254:33393 requested a full tablet report, sending...
I20260808 17:40:52.570319 10923 ts_manager.cc:194] Registered new tserver with Master: 5d0457fb411247bc9411edc9a08b0628 (127.9.187.193:38523)
I20260808 17:40:52.570914 10923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:52801
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:40:52.590538 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33393
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:41999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:52.669919 11220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:52.670146 11220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:52.670182 11220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:52.671298 11220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:52.671339 11220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:52.671375 11220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:40:52.672825 11220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:41999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33393
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:52.673053 11220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:52.673260 11220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:52.677877 11233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:52.677904 11227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:52.677901 11228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:52.678010 11220 server_base.cc:1034] running on GCE node
I20260808 17:40:52.679348 11220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:52.680363 11220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:52.681512 11220 hybrid_clock.cc:648] HybridClock initialized: now 1786210852681498 us; error 29 us; skew 500 ppm
Aug 08 17:40:52 dist-test-slave-bqcl krb5kdc[10855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:52.684187 11220 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:40:52.684582 11220 webserver.cc:460] Webserver started at http://127.9.187.194:35709/ using document root <none> and password file <none>
I20260808 17:40:52.684772 11220 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:52.684818 11220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:52.684938 11220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:52.685905 11220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "d38753b8600b414296b8bb2dac8be29f"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "a4e2466f0300f0f4bf6547ff20763230"
server_key_iv: "0909e912127ddbc3098d230c6da4798d"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.686312 11220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "d38753b8600b414296b8bb2dac8be29f"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "a4e2466f0300f0f4bf6547ff20763230"
server_key_iv: "0909e912127ddbc3098d230c6da4798d"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.687600 11220 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:40:52.688213 11242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.688390 11220 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.688474 11220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "d38753b8600b414296b8bb2dac8be29f"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "a4e2466f0300f0f4bf6547ff20763230"
server_key_iv: "0909e912127ddbc3098d230c6da4798d"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.688532 11220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:52.713400 11220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:52.715193 11220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:52.715317 11220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:52.715518 11220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:40:52.715802 11220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:52.715837 11220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.715864 11220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:52.715888 11220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.721287 11220 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:38231
I20260808 17:40:52.721345 11425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:38231 every 8 connection(s)
I20260808 17:40:52.721612 11220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:40:52.724867 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 11220
I20260808 17:40:52.724960 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:40:52.725117 9967 external_mini_cluster.cc:1428] Setting key 8ec86c45292adade954f6dd50a5c181a
Aug 08 17:40:52 dist-test-slave-bqcl krb5kdc[10855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:52.731091 10995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.722261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:43349 (local address 127.9.187.254:33393)
0808 17:40:52.722306 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:52.722308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:52.722498 (+ 190us) server_negotiation.cc:407] Connection header received
0808 17:40:52.723356 (+ 858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:52.723357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:52.723368 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:52.723418 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:52.723972 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.724461 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.725689 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.725936 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.726023 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.728353 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:52.728354 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:52.728354 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:52.728361 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:52.729643 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:52.730150 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:52.730152 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:52.730152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:52.730214 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:52.730485 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:52.730486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:52.730486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:52.730598 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:52.730649 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:52.730949 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 17:40:52.731029 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:40:52.731407 11431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.722248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33393 (local address 127.9.187.194:43349)
0808 17:40:52.722381 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:52.722416 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:52.723267 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:52.723475 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:52.723478 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:52.723718 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:52.723898 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.723902 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.724524 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.724525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.725609 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.725612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.726028 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.726029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.726181 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.726638 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:52.726647 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:52.728246 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:52.729730 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:52.729739 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:52.729742 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:52.730046 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:52.730274 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:52.730275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:52.730275 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:52.730416 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:52.730657 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:52.730662 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:52.730818 (+ 156us) client_negotiation.cc:769] Sending connection context
0808 17:40:52.730939 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 17:40:52.731099 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
I20260808 17:40:52.731884 11429 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33393
I20260808 17:40:52.731973 11429 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:52.732141 11429 heartbeater.cc:511] Master 127.9.187.254:33393 requested a full tablet report, sending...
I20260808 17:40:52.732484 10923 ts_manager.cc:194] Registered new tserver with Master: d38753b8600b414296b8bb2dac8be29f (127.9.187.194:38231)
I20260808 17:40:52.732838 10923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:43349
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:40:52.750581 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33393
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:41999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:52.831543 11435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:52.831750 11435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:52.831772 11435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:52.832877 11435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:52.832921 11435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:52.832945 11435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:40:52.834434 11435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:41999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33393
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:52.834661 11435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:52.834875 11435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:52.839706 11448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:52.839743 11444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:52.839797 11435 server_base.cc:1034] running on GCE node
W20260808 17:40:52.839726 11445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:52.840260 11435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:52.840514 11435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:52.841645 11435 hybrid_clock.cc:648] HybridClock initialized: now 1786210852841626 us; error 35 us; skew 500 ppm
Aug 08 17:40:52 dist-test-slave-bqcl krb5kdc[10855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:52.844110 11435 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:40:52.844533 11435 webserver.cc:460] Webserver started at http://127.9.187.195:43639/ using document root <none> and password file <none>
I20260808 17:40:52.844744 11435 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:52.844787 11435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:52.844904 11435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:52.845913 11435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "29f41d5025ff467aae793f2cdb4828e9"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "f603fa771dd1f27464a40cd7050799a9"
server_key_iv: "6e50f30c43666fab4d0c663d0a76a658"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.846252 11435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "29f41d5025ff467aae793f2cdb4828e9"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "f603fa771dd1f27464a40cd7050799a9"
server_key_iv: "6e50f30c43666fab4d0c663d0a76a658"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.847478 11435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:40:52.848157 11462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.848309 11435 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:40:52.848384 11435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "29f41d5025ff467aae793f2cdb4828e9"
format_stamp: "Formatted at 2026-08-08 17:40:52 on dist-test-slave-bqcl"
server_key: "f603fa771dd1f27464a40cd7050799a9"
server_key_iv: "6e50f30c43666fab4d0c663d0a76a658"
server_key_version: "encryptionkey@0"
I20260808 17:40:52.848450 11435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:52.864356 11435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:52.866403 11435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:52.866532 11435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:52.866732 11435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:40:52.867018 11435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:52.867053 11435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.867080 11435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:52.867097 11435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:52.873144 11435 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:40529
I20260808 17:40:52.873181 11656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:40529 every 8 connection(s)
I20260808 17:40:52.873471 11435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:40:52.875267 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 11435
I20260808 17:40:52.875361 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:40:52.875512 9967 external_mini_cluster.cc:1428] Setting key dc29d05d37fbd85e4e8e26fd2f2db383
Aug 08 17:40:52 dist-test-slave-bqcl krb5kdc[10855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:52.882537 10995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.874174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:43767 (local address 127.9.187.254:33393)
0808 17:40:52.874219 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:52.874220 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:52.874418 (+ 198us) server_negotiation.cc:407] Connection header received
0808 17:40:52.875373 (+ 955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:52.875374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:52.875388 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:52.875446 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:52.876254 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.876767 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.877794 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.877973 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.878020 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.880136 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:52.880137 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:52.880138 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:52.880144 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:52.881381 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:52.881724 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:52.881725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:52.881725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:52.881771 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:52.882012 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:52.882012 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:52.882012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:52.882106 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:52.882197 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:52.882413 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 17:40:52.882474 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:40:52.882709 11662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.874117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33393 (local address 127.9.187.195:43767)
0808 17:40:52.874297 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:52.874331 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:52.875266 (+ 935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:52.875516 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:52.875519 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:52.875856 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:52.876148 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.876155 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.876856 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.876857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.877700 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.877702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.878031 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.878032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.878178 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.878597 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:52.878606 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:52.880058 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:52.881453 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:52.881459 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:52.881461 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:52.881668 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:52.881842 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:52.881843 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:52.881843 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:52.881953 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:52.882191 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:52.882196 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:52.882311 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 17:40:52.882393 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 17:40:52.882509 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":83,"threads_started":1}
I20260808 17:40:52.883127 11659 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33393
I20260808 17:40:52.883208 11659 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:52.883343 11659 heartbeater.cc:511] Master 127.9.187.254:33393 requested a full tablet report, sending...
I20260808 17:40:52.883657 10923 ts_manager.cc:194] Registered new tserver with Master: 29f41d5025ff467aae793f2cdb4828e9 (127.9.187.195:40529)
I20260808 17:40:52.883980 10923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:43767
I20260808 17:40:52.886978 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:40:52.893949 10995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.888832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40532 (local address 127.9.187.254:33393)
0808 17:40:52.888880 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:52.888883 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:52.888992 (+ 109us) server_negotiation.cc:407] Connection header received
0808 17:40:52.889049 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:52.889050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:52.889059 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:52.889100 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:52.889621 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.890069 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.890777 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.890955 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.891025 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.892092 (+ 1067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:52.892093 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:52.892094 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:52.892100 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:52.893131 (+ 1031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:52.893410 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:52.893411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:52.893411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:52.893454 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:52.893581 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:52.893581 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:52.893581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:52.893697 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:52.893765 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:52.893838 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 17:40:52.893888 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:40:52.896539 10923 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40532:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:40:52.898393 10923 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:40:52.904929 11671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.900935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:38523 (local address 127.0.0.1:38376)
0808 17:40:52.901402 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:52.901411 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:52.901463 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:52.901814 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:52.901815 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:52.901818 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:52.901873 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.901875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.903143 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.903144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.903890 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.903892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.904643 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.904645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.904724 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.904739 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 17:40:52.904800 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 17:40:52.904852 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":2,"thread_start_us":57,"threads_started":1}
I20260808 17:40:52.904942 11674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.901112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38376 (local address 127.9.187.193:38523)
0808 17:40:52.901294 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:52.901299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:52.901468 (+ 169us) server_negotiation.cc:407] Connection header received
0808 17:40:52.901522 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:52.901524 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:52.901540 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:52.901729 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:52.901941 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.903037 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.903972 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.904565 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.904628 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.904695 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:52.904821 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 17:40:52.904860 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":83,"threads_started":1}
I20260808 17:40:52.905198 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.900935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:40529 (local address 127.0.0.1:35604)
0808 17:40:52.901194 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:52.901235 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:52.901302 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:52.901710 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:52.901713 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:52.901715 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:52.901780 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.901781 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.902815 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.902816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.904076 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.904079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.904963 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.904964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.905043 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.905047 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:40:52.905075 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 17:40:52.905128 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":62,"threads_started":1}
I20260808 17:40:52.905323 11675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.901173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49222 (local address 127.9.187.194:38231)
0808 17:40:52.901345 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:52.901348 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:52.901573 (+ 225us) server_negotiation.cc:407] Connection header received
0808 17:40:52.901634 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:52.901636 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:52.901650 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:52.901715 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:52.901892 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.902992 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.904241 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.904905 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.904947 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.904999 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:52.905185 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 17:40:52.905232 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":75,"threads_started":1}
I20260808 17:40:52.905611 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.901294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35604 (local address 127.9.187.195:40529)
0808 17:40:52.901493 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:52.901496 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:52.901504 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:40:52.901535 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:52.901537 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:52.901550 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:52.901688 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:52.901852 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.902726 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.904175 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.904862 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.905415 (+ 553us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.905477 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:52.905500 (+ 23us) server_negotiation.cc:299] Negotiation successful
0808 17:40:52.905538 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":133,"threads_started":1}
I20260808 17:40:52.905622 11672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:52.900962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:38231 (local address 127.0.0.1:49222)
0808 17:40:52.901509 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:52.901518 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:52.901569 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:52.901800 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:52.901800 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:52.901802 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:52.901837 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.901839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.903099 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.903100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.904156 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:52.904158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:52.905054 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:52.905055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:52.905106 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:52.905109 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:40:52.905156 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 17:40:52.905188 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":52,"threads_started":1}
I20260808 17:40:52.906070 11112 tablet_service.cc:1467] Processing CreateTablet for tablet 347e337168f441008bece95364d83266 (DEFAULT_TABLE table=test-table [id=635c6b123ee64b6e98f2364ed3faa988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:52.906296 11533 tablet_service.cc:1467] Processing CreateTablet for tablet 347e337168f441008bece95364d83266 (DEFAULT_TABLE table=test-table [id=635c6b123ee64b6e98f2364ed3faa988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:52.906294 11317 tablet_service.cc:1467] Processing CreateTablet for tablet 347e337168f441008bece95364d83266 (DEFAULT_TABLE table=test-table [id=635c6b123ee64b6e98f2364ed3faa988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:52.906504 11112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 347e337168f441008bece95364d83266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:52.906610 11317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 347e337168f441008bece95364d83266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:52.906626 11533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 347e337168f441008bece95364d83266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:52.909288 11678 tablet_bootstrap.cc:492] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628: Bootstrap starting.
I20260808 17:40:52.909891 11678 tablet_bootstrap.cc:654] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:52.910315 11681 tablet_bootstrap.cc:492] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f: Bootstrap starting.
I20260808 17:40:52.910544 11683 tablet_bootstrap.cc:492] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9: Bootstrap starting.
I20260808 17:40:52.910702 11678 log.cc:824] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:52.911052 11681 tablet_bootstrap.cc:654] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:52.911525 11683 tablet_bootstrap.cc:654] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:52.911556 11681 log.cc:824] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:52.911635 11678 tablet_bootstrap.cc:492] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628: No bootstrap required, opened a new log
I20260808 17:40:52.911715 11678 ts_tablet_manager.cc:1397] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 17:40:52.912073 11683 log.cc:824] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:52.912391 11681 tablet_bootstrap.cc:492] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f: No bootstrap required, opened a new log
I20260808 17:40:52.912652 11681 ts_tablet_manager.cc:1397] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:40:52.912730 11683 tablet_bootstrap.cc:492] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9: No bootstrap required, opened a new log
I20260808 17:40:52.912847 11683 ts_tablet_manager.cc:1397] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:40:52.914281 11678 raft_consensus.cc:348] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0457fb411247bc9411edc9a08b0628" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 38523 } } peers { permanent_uuid: "29f41d5025ff467aae793f2cdb4828e9" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 40529 } } peers { permanent_uuid: "d38753b8600b414296b8bb2dac8be29f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 38231 } }
I20260808 17:40:52.914574 11678 raft_consensus.cc:374] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:52.914656 11678 raft_consensus.cc:729] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0457fb411247bc9411edc9a08b0628, State: Initialized, Role: FOLLOWER
I20260808 17:40:52.914805 11678 consensus_queue.cc:260] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0457fb411247bc9411edc9a08b0628" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 38523 } } peers { permanent_uuid: "29f41d5025ff467aae793f2cdb4828e9" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 40529 } } peers { permanent_uuid: "d38753b8600b414296b8bb2dac8be29f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 38231 } }
I20260808 17:40:52.914706 11683 raft_consensus.cc:348] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0457fb411247bc9411edc9a08b0628" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 38523 } } peers { permanent_uuid: "29f41d5025ff467aae793f2cdb4828e9" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 40529 } } peers { permanent_uuid: "d38753b8600b414296b8bb2dac8be29f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 38231 } }
I20260808 17:40:52.914912 11683 raft_consensus.cc:374] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:52.914979 11683 raft_consensus.cc:729] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29f41d5025ff467aae793f2cdb4828e9, State: Initialized, Role: FOLLOWER
I20260808 17:40:52.914834 11681 raft_consensus.cc:348] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0457fb411247bc9411edc9a08b0628" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 38523 } } peers { permanent_uuid: "29f41d5025ff467aae793f2cdb4828e9" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 40529 } } peers { permanent_uuid: "d38753b8600b414296b8bb2dac8be29f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 38231 } }
I20260808 17:40:52.915027 11681 raft_consensus.cc:374] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:52.915082 11681 raft_consensus.cc:729] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d38753b8600b414296b8bb2dac8be29f, State: Initialized, Role: FOLLOWER
I20260808 17:40:52.915109 11683 consensus_queue.cc:260] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0457fb411247bc9411edc9a08b0628" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 38523 } } peers { permanent_uuid: "29f41d5025ff467aae793f2cdb4828e9" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 40529 } } peers { permanent_uuid: "d38753b8600b414296b8bb2dac8be29f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 38231 } }
I20260808 17:40:52.915259 11678 ts_tablet_manager.cc:1428] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260808 17:40:52.915267 11681 consensus_queue.cc:260] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0457fb411247bc9411edc9a08b0628" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 38523 } } peers { permanent_uuid: "29f41d5025ff467aae793f2cdb4828e9" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 40529 } } peers { permanent_uuid: "d38753b8600b414296b8bb2dac8be29f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 38231 } }
I20260808 17:40:52.915441 11215 heartbeater.cc:503] Master 127.9.187.254:33393 was elected leader, sending a full tablet report...
I20260808 17:40:52.915531 11683 ts_tablet_manager.cc:1428] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 17:40:52.915532 11681 ts_tablet_manager.cc:1428] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:40:52.915653 11429 heartbeater.cc:503] Master 127.9.187.254:33393 was elected leader, sending a full tablet report...
I20260808 17:40:52.915884 11659 heartbeater.cc:503] Master 127.9.187.254:33393 was elected leader, sending a full tablet report...
W20260808 17:40:52.972175 11430 tablet.cc:2369] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:40:53.060171 11216 tablet.cc:2369] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:40:53.124014 11661 tablet.cc:2369] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:40:53.154961 11688 raft_consensus.cc:482] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:40:53.155092 11688 raft_consensus.cc:504] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0457fb411247bc9411edc9a08b0628" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 38523 } } peers { permanent_uuid: "29f41d5025ff467aae793f2cdb4828e9" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 40529 } } peers { permanent_uuid: "d38753b8600b414296b8bb2dac8be29f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 38231 } }
I20260808 17:40:53.155661 11688 leader_election.cc:288] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0457fb411247bc9411edc9a08b0628 (127.9.187.193:38523), d38753b8600b414296b8bb2dac8be29f (127.9.187.194:38231)
I20260808 17:40:53.158547 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:53.155936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:38523 (local address 127.9.187.195:48821)
0808 17:40:53.156171 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:53.156182 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:53.156246 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:53.156363 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:53.156364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:53.156365 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:53.156431 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:53.156432 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.157032 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.157032 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:53.157779 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:53.157782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.158335 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.158336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:53.158403 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:53.158407 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:40:53.158453 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:40:53.158483 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":163,"threads_started":1}
I20260808 17:40:53.158576 11674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:53.155918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:48821 (local address 127.9.187.193:38523)
0808 17:40:53.155982 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:53.155984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:53.156252 (+ 268us) server_negotiation.cc:407] Connection header received
0808 17:40:53.156295 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:53.156296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:53.156307 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:53.156348 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:53.156489 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.156962 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.157864 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.158255 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.158311 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:53.158318 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:53.158470 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 17:40:53.158508 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 17:40:53.158726 11662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:53.155916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:38231 (local address 127.9.187.195:39073)
0808 17:40:53.155975 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:53.155987 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:53.156032 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:53.156154 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:53.156154 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:53.156156 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:53.156231 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:53.156234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.156939 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.156940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:53.157723 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:53.157725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.158400 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.158401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:53.158547 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:53.158550 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:40:53.158611 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 17:40:53.158650 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 17:40:53.158738 11675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:53.155981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:39073 (local address 127.9.187.194:38231)
0808 17:40:53.156039 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:53.156040 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:53.156052 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:40:53.156081 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:53.156082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:53.156092 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:53.156141 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:53.156313 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.156859 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.157809 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.158317 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.158390 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:53.158398 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:53.158633 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 17:40:53.158677 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:40:53.159068 11143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347e337168f441008bece95364d83266" candidate_uuid: "29f41d5025ff467aae793f2cdb4828e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0457fb411247bc9411edc9a08b0628" is_pre_election: true
I20260808 17:40:53.159073 11345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347e337168f441008bece95364d83266" candidate_uuid: "29f41d5025ff467aae793f2cdb4828e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d38753b8600b414296b8bb2dac8be29f" is_pre_election: true
I20260808 17:40:53.159237 11143 raft_consensus.cc:2454] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29f41d5025ff467aae793f2cdb4828e9 in term 0.
I20260808 17:40:53.159257 11345 raft_consensus.cc:2454] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29f41d5025ff467aae793f2cdb4828e9 in term 0.
I20260808 17:40:53.159557 11464 leader_election.cc:302] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29f41d5025ff467aae793f2cdb4828e9, d38753b8600b414296b8bb2dac8be29f; no voters:
I20260808 17:40:53.159684 11688 raft_consensus.cc:2781] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:40:53.159741 11688 raft_consensus.cc:482] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:40:53.159757 11688 raft_consensus.cc:3037] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:53.160559 11688 raft_consensus.cc:504] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0457fb411247bc9411edc9a08b0628" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 38523 } } peers { permanent_uuid: "29f41d5025ff467aae793f2cdb4828e9" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 40529 } } peers { permanent_uuid: "d38753b8600b414296b8bb2dac8be29f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 38231 } }
I20260808 17:40:53.160666 11688 leader_election.cc:288] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0457fb411247bc9411edc9a08b0628 (127.9.187.193:38523), d38753b8600b414296b8bb2dac8be29f (127.9.187.194:38231)
I20260808 17:40:53.160847 11345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347e337168f441008bece95364d83266" candidate_uuid: "29f41d5025ff467aae793f2cdb4828e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d38753b8600b414296b8bb2dac8be29f"
I20260808 17:40:53.160907 11345 raft_consensus.cc:3037] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:53.161566 11345 raft_consensus.cc:2454] T 347e337168f441008bece95364d83266 P d38753b8600b414296b8bb2dac8be29f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29f41d5025ff467aae793f2cdb4828e9 in term 1.
I20260808 17:40:53.161734 11464 leader_election.cc:302] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29f41d5025ff467aae793f2cdb4828e9, d38753b8600b414296b8bb2dac8be29f; no voters:
I20260808 17:40:53.161834 11688 raft_consensus.cc:2781] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:53.161847 11143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347e337168f441008bece95364d83266" candidate_uuid: "29f41d5025ff467aae793f2cdb4828e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0457fb411247bc9411edc9a08b0628"
I20260808 17:40:53.161916 11143 raft_consensus.cc:3037] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:53.161981 11688 raft_consensus.cc:686] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [term 1 LEADER]: Becoming Leader. State: Replica: 29f41d5025ff467aae793f2cdb4828e9, State: Running, Role: LEADER
I20260808 17:40:53.162063 11688 consensus_queue.cc:237] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0457fb411247bc9411edc9a08b0628" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 38523 } } peers { permanent_uuid: "29f41d5025ff467aae793f2cdb4828e9" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 40529 } } peers { permanent_uuid: "d38753b8600b414296b8bb2dac8be29f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 38231 } }
I20260808 17:40:53.162985 10920 catalog_manager.cc:5495] T 347e337168f441008bece95364d83266 P 29f41d5025ff467aae793f2cdb4828e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29f41d5025ff467aae793f2cdb4828e9 (127.9.187.195). New cstate: current_term: 1 leader_uuid: "29f41d5025ff467aae793f2cdb4828e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0457fb411247bc9411edc9a08b0628" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 38523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29f41d5025ff467aae793f2cdb4828e9" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 40529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d38753b8600b414296b8bb2dac8be29f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260808 17:40:53.163304 11143 raft_consensus.cc:2454] T 347e337168f441008bece95364d83266 P 5d0457fb411247bc9411edc9a08b0628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29f41d5025ff467aae793f2cdb4828e9 in term 1.
Aug 08 17:40:53 dist-test-slave-bqcl krb5kdc[10855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.193@KRBTEST.COM
I20260808 17:40:53.189495 11674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:53.182102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38382 (local address 127.9.187.193:38523)
0808 17:40:53.182188 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:53.182190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:53.182265 (+ 75us) server_negotiation.cc:407] Connection header received
0808 17:40:53.182318 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:53.182319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:53.182327 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:53.182373 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:53.182901 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.183358 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.184043 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.184226 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.184274 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:53.186728 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:53.186739 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:53.186739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:53.186745 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:53.188319 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:53.188716 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:53.188720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:53.188721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:53.188832 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:53.189009 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:53.189010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:53.189010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:53.189145 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:53.189252 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:53.189367 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 17:40:53.189429 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 17:40:53 dist-test-slave-bqcl krb5kdc[10855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210853, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 17:40:53 dist-test-slave-bqcl krb5kdc[10855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210853, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.187.193@KRBTEST.COM
I20260808 17:40:53.213068 11674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:53.206615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38390 (local address 127.9.187.193:38523)
0808 17:40:53.206689 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:53.206691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:53.206761 (+ 70us) server_negotiation.cc:407] Connection header received
0808 17:40:53.206826 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:53.206827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:53.206837 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:53.206876 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:53.207402 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.207887 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.208591 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.208792 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.208846 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:53.210957 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:53.210958 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:53.210959 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:53.210965 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:53.212211 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:53.212507 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:53.212508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:53.212508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:53.212552 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:53.212680 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:53.212681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:53.212681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:53.212761 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:53.212827 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:53.212936 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 17:40:53.212994 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 17:40:53 dist-test-slave-bqcl krb5kdc[10855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 17:40:53 dist-test-slave-bqcl krb5kdc[10855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.193@KRBTEST.COM
I20260808 17:40:53.234071 11674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:53.228162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38402 (local address 127.9.187.193:38523)
0808 17:40:53.228221 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:53.228223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:53.228310 (+ 87us) server_negotiation.cc:407] Connection header received
0808 17:40:53.228353 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:53.228354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:53.228365 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:53.228406 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:53.228882 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.229336 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.230018 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:53.230262 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:53.230315 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:53.232256 (+ 1941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:53.232257 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:53.232257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:53.232264 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:53.233297 (+ 1033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:53.233571 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:53.233572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:53.233572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:53.233614 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:53.233740 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:53.233740 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:53.233740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:53.233812 (+ 72us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:53.233875 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:53.233942 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:40:53.233994 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 17:40:53.234849 11082 tablet_service.cc:2908] Rejecting scan request for tablet 347e337168f441008bece95364d83266: Uninitialized: clean time has not yet been initialized
I20260808 17:40:53.235806 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 11025
I20260808 17:40:53.249455 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 11220
I20260808 17:40:53.255788 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 11435
I20260808 17:40:53.265136 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 10873
2026-08-08T17:40:53Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2298 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:40:53 dist-test-slave-bqcl krb5kdc[11712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:40:53 dist-test-slave-bqcl krb5kdc[11712](info): set up 2 sockets
Aug 08 17:40:53 dist-test-slave-bqcl krb5kdc[11712](info): commencing operation
krb5kdc: starting...
W20260808 17:40:54.423919 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:40:54 dist-test-slave-bqcl krb5kdc[11712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:40:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:40:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:40:54.538069 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:40055
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:40055
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:54.619464 11737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:54.619671 11737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:54.619691 11737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:54.620797 11737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:40:54.620839 11737 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 17:40:54.620852 11737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:54.620864 11737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:54.620893 11737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:40:54.620914 11737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:40:54.622375 11737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:40055
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:40055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:54.622624 11737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:54.622838 11737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:54.627429 11751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:54.627610 11737 server_base.cc:1034] running on GCE node
W20260808 17:40:54.627549 11743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:54.627494 11748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:54.627978 11737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:54.628270 11737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:54.629410 11737 hybrid_clock.cc:648] HybridClock initialized: now 1786210854629396 us; error 26 us; skew 500 ppm
Aug 08 17:40:54 dist-test-slave-bqcl krb5kdc[11712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:54.631805 11737 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:40:54.632198 11737 webserver.cc:460] Webserver started at http://127.9.187.254:35375/ using document root <none> and password file <none>
I20260808 17:40:54.632364 11737 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:54.632401 11737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:54.632489 11737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:54.633450 11737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "715c337dfeef443ba06ee584bc96f57a"
format_stamp: "Formatted at 2026-08-08 17:40:54 on dist-test-slave-bqcl"
server_key: "c4cf03ed42498ccb7692e087e396fe30"
server_key_iv: "60ed3c5e4f7ed9bd5390964530c6ebef"
server_key_version: "encryptionkey@0"
I20260808 17:40:54.633749 11737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "715c337dfeef443ba06ee584bc96f57a"
format_stamp: "Formatted at 2026-08-08 17:40:54 on dist-test-slave-bqcl"
server_key: "c4cf03ed42498ccb7692e087e396fe30"
server_key_iv: "60ed3c5e4f7ed9bd5390964530c6ebef"
server_key_version: "encryptionkey@0"
I20260808 17:40:54.634990 11737 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:40:54.635634 11762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:54.635802 11737 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:40:54.635882 11737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "715c337dfeef443ba06ee584bc96f57a"
format_stamp: "Formatted at 2026-08-08 17:40:54 on dist-test-slave-bqcl"
server_key: "c4cf03ed42498ccb7692e087e396fe30"
server_key_iv: "60ed3c5e4f7ed9bd5390964530c6ebef"
server_key_version: "encryptionkey@0"
I20260808 17:40:54.635936 11737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:54.645671 11737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:54.647389 11737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:54.647495 11737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:54.652171 11737 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:40055
I20260808 17:40:54.652252 11864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:40055 every 8 connection(s)
I20260808 17:40:54.652537 11737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:40:54.652912 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 11737
I20260808 17:40:54.653010 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:40:54.653167 9967 external_mini_cluster.cc:1428] Setting key eee529c76863a6e15cb8caadc9bcd41a
I20260808 17:40:54.653258 11865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:54.656651 11865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a: Bootstrap starting.
I20260808 17:40:54.657249 11865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:54.657560 11865 log.cc:824] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:54.658329 11865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a: No bootstrap required, opened a new log
Aug 08 17:40:54 dist-test-slave-bqcl krb5kdc[11712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:54.660351 11865 raft_consensus.cc:348] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715c337dfeef443ba06ee584bc96f57a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40055 } }
I20260808 17:40:54.660519 11865 raft_consensus.cc:374] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:54.660557 11865 raft_consensus.cc:729] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 715c337dfeef443ba06ee584bc96f57a, State: Initialized, Role: FOLLOWER
I20260808 17:40:54.660693 11865 consensus_queue.cc:260] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715c337dfeef443ba06ee584bc96f57a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40055 } }
I20260808 17:40:54.660777 11865 raft_consensus.cc:388] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:40:54.660817 11865 raft_consensus.cc:482] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:40:54.660868 11865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:54.661521 11865 raft_consensus.cc:504] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715c337dfeef443ba06ee584bc96f57a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40055 } }
I20260808 17:40:54.661643 11865 leader_election.cc:302] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 715c337dfeef443ba06ee584bc96f57a; no voters:
I20260808 17:40:54.661796 11865 leader_election.cc:288] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:40:54.661840 11873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:54.661993 11873 raft_consensus.cc:686] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [term 1 LEADER]: Becoming Leader. State: Replica: 715c337dfeef443ba06ee584bc96f57a, State: Running, Role: LEADER
I20260808 17:40:54.662051 11865 sys_catalog.cc:564] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:40:54.662199 11873 consensus_queue.cc:237] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715c337dfeef443ba06ee584bc96f57a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40055 } }
I20260808 17:40:54.662542 11873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 715c337dfeef443ba06ee584bc96f57a. Latest consensus state: current_term: 1 leader_uuid: "715c337dfeef443ba06ee584bc96f57a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715c337dfeef443ba06ee584bc96f57a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40055 } } }
I20260808 17:40:54.662711 11873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [sys.catalog]: This master's current role is: LEADER
I20260808 17:40:54.662578 11877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "715c337dfeef443ba06ee584bc96f57a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "715c337dfeef443ba06ee584bc96f57a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40055 } } }
I20260808 17:40:54.662963 11877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a [sys.catalog]: This master's current role is: LEADER
I20260808 17:40:54.663344 11891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:40:54.663954 11891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:40:54.664242 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:54.653661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50538 (local address 127.9.187.254:40055)
0808 17:40:54.653850 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:54.653861 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:54.653894 (+ 33us) server_negotiation.cc:407] Connection header received
0808 17:40:54.654407 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:54.654418 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:54.654481 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:54.654634 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:54.655186 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:54.656516 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:54.657281 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:54.657848 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:54.657929 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:54.660152 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:54.660157 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:54.660157 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:54.660169 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:54.662108 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:54.662648 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:54.662651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:54.662652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:54.662758 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:54.662997 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:54.662998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:54.662998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:54.663314 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:54.663830 (+ 516us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:54.663905 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 17:40:54.664040 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
I20260808 17:40:54.665366 11891 catalog_manager.cc:1347] Generated new cluster ID: b1bd0a6b58894c76876a1f3aeb4fae36
I20260808 17:40:54.665418 11891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:40:54.675850 11891 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:40:54.676350 11891 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:40:54.680871 11891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a: Generated new TSK 0
I20260808 17:40:54.681023 11891 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:40:54.717401 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40055
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:54.798003 11909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:54.798230 11909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:54.798269 11909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:54.799403 11909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:54.799443 11909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:54.799470 11909 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:40:54.799490 11909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:40:54.800932 11909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.187.254:40055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:54.801252 11909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:54.801481 11909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:54.806310 11922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:54.806320 11916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:54.806515 11909 server_base.cc:1034] running on GCE node
W20260808 17:40:54.806325 11917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:54.806746 11909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:54.806958 11909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:54.808104 11909 hybrid_clock.cc:648] HybridClock initialized: now 1786210854808091 us; error 29 us; skew 500 ppm
Aug 08 17:40:54 dist-test-slave-bqcl krb5kdc[11712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:54.810539 11909 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:40:54.810907 11909 webserver.cc:460] Webserver started at http://127.9.187.193:43471/ using document root <none> and password file <none>
I20260808 17:40:54.811087 11909 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:54.811125 11909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:54.811214 11909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:54.812146 11909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "1052dec1bfdc458b9f08d17d446b7894"
format_stamp: "Formatted at 2026-08-08 17:40:54 on dist-test-slave-bqcl"
server_key: "0cc16e2ef57829d7b85e294c7efe18c3"
server_key_iv: "7505841e28594df0b9c11edcbd52f8a3"
server_key_version: "encryptionkey@0"
I20260808 17:40:54.812433 11909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "1052dec1bfdc458b9f08d17d446b7894"
format_stamp: "Formatted at 2026-08-08 17:40:54 on dist-test-slave-bqcl"
server_key: "0cc16e2ef57829d7b85e294c7efe18c3"
server_key_iv: "7505841e28594df0b9c11edcbd52f8a3"
server_key_version: "encryptionkey@0"
I20260808 17:40:54.813669 11909 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:40:54.814380 11932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:54.814538 11909 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:40:54.814623 11909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "1052dec1bfdc458b9f08d17d446b7894"
format_stamp: "Formatted at 2026-08-08 17:40:54 on dist-test-slave-bqcl"
server_key: "0cc16e2ef57829d7b85e294c7efe18c3"
server_key_iv: "7505841e28594df0b9c11edcbd52f8a3"
server_key_version: "encryptionkey@0"
I20260808 17:40:54.814677 11909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:54.847891 11909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:54.849773 11909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:54.849887 11909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:54.850421 11909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:54.850466 11909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:54.850489 11909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:54.850500 11909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:54.857326 11909 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:46179
I20260808 17:40:54.857394 12122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:46179 every 8 connection(s)
Aug 08 17:40:54 dist-test-slave-bqcl krb5kdc[11712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:54.857748 11909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:40:54.860635 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:54.850994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:41507 (local address 127.9.187.254:40055)
0808 17:40:54.851068 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:54.851070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:54.851291 (+ 221us) server_negotiation.cc:407] Connection header received
0808 17:40:54.851973 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:54.851974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:54.851987 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:54.852069 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:54.852950 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:54.853735 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:54.855325 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:54.855613 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:54.855672 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:54.858330 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:54.858331 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:54.858332 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:54.858339 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:54.859618 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:54.859934 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:54.859935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:54.859935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:54.859981 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:54.860153 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:54.860153 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:54.860153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:54.860247 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:54.860291 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:54.860484 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 17:40:54.860549 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 17:40:54.860761 11944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:54.850953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40055 (local address 127.9.187.193:41507)
0808 17:40:54.851138 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:54.851191 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:54.851851 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:54.852143 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:54.852147 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:54.852561 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:54.852863 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:54.852871 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:54.853849 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:54.853850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:54.855216 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:54.855220 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:54.855700 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:54.855701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:54.855867 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:54.856418 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:54.856430 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:54.858247 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:54.859675 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:54.859677 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:54.859678 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:54.859880 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:54.860023 (+ 143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:54.860024 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:54.860024 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:54.860112 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:54.860288 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:54.860290 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:54.860398 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 17:40:54.860474 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 17:40:54.860590 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260808 17:40:54.861195 12125 heartbeater.cc:347] Connected to a master server at 127.9.187.254:40055
I20260808 17:40:54.861286 12125 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:54.861457 12125 heartbeater.cc:511] Master 127.9.187.254:40055 requested a full tablet report, sending...
I20260808 17:40:54.862066 11788 ts_manager.cc:194] Registered new tserver with Master: 1052dec1bfdc458b9f08d17d446b7894 (127.9.187.193:46179)
I20260808 17:40:54.862725 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 11909
I20260808 17:40:54.862819 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:40:54.862906 11788 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:41507
I20260808 17:40:54.862989 9967 external_mini_cluster.cc:1428] Setting key 26eb4404df5203fd9274036654d432e9
I20260808 17:40:54.868582 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:54.862311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:34343 (local address 127.9.187.254:40055)
0808 17:40:54.862361 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:54.862363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:54.863216 (+ 853us) server_negotiation.cc:407] Connection header received
0808 17:40:54.863564 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:54.863565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:54.863573 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:54.863601 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:54.863962 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:54.864558 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:54.865212 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:54.865478 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:54.865530 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:54.866400 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:54.866401 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:54.866401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:54.866407 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:54.867596 (+ 1189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:54.867959 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:54.867960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:54.867960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:54.868011 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:54.868198 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:54.868199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:54.868199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:54.868283 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:54.868325 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:54.868469 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 17:40:54.868526 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:40:54.868633 12136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:54.862260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40055 (local address 127.9.187.193:34343)
0808 17:40:54.863155 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:54.863167 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:54.863242 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:54.863666 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:54.863667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:54.863839 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:54.863888 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:54.863889 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:54.864648 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:54.864648 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:54.865133 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:54.865135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:54.865542 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:54.865543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:54.865622 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:54.865969 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:54.865974 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:54.866326 (+ 352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:54.867675 (+ 1349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:54.867676 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:54.867676 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:54.867886 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:54.868076 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:54.868076 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:54.868077 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:54.868142 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:54.868335 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:54.868336 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:54.868382 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 17:40:54.868454 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 17:40:54.868544 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":867,"thread_start_us":73,"threads_started":1}
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:40:54.888082 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40055
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:54.967685 12139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:54.967880 12139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:54.967914 12139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:54.969089 12139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:54.969129 12139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:54.969149 12139 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:40:54.969165 12139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:40:54.970573 12139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.187.254:40055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:54.970754 12139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:54.970929 12139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:54.975554 12146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:54.975646 12139 server_base.cc:1034] running on GCE node
W20260808 17:40:54.975603 12150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:54.975589 12148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:54.975932 12139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:54.976167 12139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:54.977300 12139 hybrid_clock.cc:648] HybridClock initialized: now 1786210854977289 us; error 24 us; skew 500 ppm
Aug 08 17:40:54 dist-test-slave-bqcl krb5kdc[11712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:54.979667 12139 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:40:54.980052 12139 webserver.cc:460] Webserver started at http://127.9.187.194:43793/ using document root <none> and password file <none>
I20260808 17:40:54.980244 12139 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:54.980285 12139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:54.980402 12139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:54.981349 12139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "ba9ad93f276e48649adda162c3081282"
format_stamp: "Formatted at 2026-08-08 17:40:54 on dist-test-slave-bqcl"
server_key: "34afb0350980bf9263ef180c7f4d90ab"
server_key_iv: "38ad83febfedfe2c160de2a2e9bd2070"
server_key_version: "encryptionkey@0"
I20260808 17:40:54.981654 12139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "ba9ad93f276e48649adda162c3081282"
format_stamp: "Formatted at 2026-08-08 17:40:54 on dist-test-slave-bqcl"
server_key: "34afb0350980bf9263ef180c7f4d90ab"
server_key_iv: "38ad83febfedfe2c160de2a2e9bd2070"
server_key_version: "encryptionkey@0"
I20260808 17:40:54.983074 12139 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:40:54.983696 12158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:54.983853 12139 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:40:54.983938 12139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "ba9ad93f276e48649adda162c3081282"
format_stamp: "Formatted at 2026-08-08 17:40:54 on dist-test-slave-bqcl"
server_key: "34afb0350980bf9263ef180c7f4d90ab"
server_key_iv: "38ad83febfedfe2c160de2a2e9bd2070"
server_key_version: "encryptionkey@0"
I20260808 17:40:54.983989 12139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:54.994982 12139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:54.996824 12139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:54.996924 12139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:54.997330 12139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:54.997376 12139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:54.997395 12139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:54.997406 12139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:55.003903 12139 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:44281
I20260808 17:40:55.003986 12325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:44281 every 8 connection(s)
Aug 08 17:40:54 dist-test-slave-bqcl krb5kdc[11712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:55.004264 12139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:40:55.007580 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:54.997809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:52349 (local address 127.9.187.254:40055)
0808 17:40:54.997880 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:54.997883 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:54.998082 (+ 199us) server_negotiation.cc:407] Connection header received
0808 17:40:54.998646 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:54.998647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:54.998666 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:54.998728 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:54.999583 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.000338 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.001810 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.002117 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.002238 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.004798 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:55.004800 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:55.004800 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:55.004809 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:55.006237 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.006632 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.006634 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.006634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.006696 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.006932 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.006933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.006934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.007064 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:55.007131 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.007391 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.007482 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 17:40:55.007732 12170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:54.997764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40055 (local address 127.9.187.194:52349)
0808 17:40:54.997960 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:54.997999 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:54.998517 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:54.998826 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:54.998831 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:54.999191 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:54.999463 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:54.999470 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.000442 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.000443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.001715 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.001719 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.002246 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.002247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.002403 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.002891 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:55.002902 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:55.004698 (+ 1796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:55.006310 (+ 1612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:55.006318 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:55.006320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:55.006556 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:55.006757 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:55.006758 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:55.006758 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:55.006870 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:55.007127 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:55.007133 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:55.007266 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.007361 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.007524 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":86,"threads_started":1}
I20260808 17:40:55.008193 12326 heartbeater.cc:347] Connected to a master server at 127.9.187.254:40055
I20260808 17:40:55.008276 12326 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:55.008455 12326 heartbeater.cc:511] Master 127.9.187.254:40055 requested a full tablet report, sending...
I20260808 17:40:55.008879 11793 ts_manager.cc:194] Registered new tserver with Master: ba9ad93f276e48649adda162c3081282 (127.9.187.194:44281)
I20260808 17:40:55.009369 11793 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:52349
I20260808 17:40:55.012769 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 12139
I20260808 17:40:55.012869 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:40:55.013057 9967 external_mini_cluster.cc:1428] Setting key 1e859a1f23aa95b849c532265567ba81
I20260808 17:40:55.014626 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.009229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:36971 (local address 127.9.187.254:40055)
0808 17:40:55.009265 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.009267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.009393 (+ 126us) server_negotiation.cc:407] Connection header received
0808 17:40:55.009452 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.009453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.009463 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.009520 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:55.009929 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.010447 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.011098 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.011302 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.011357 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.012058 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:55.012059 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:55.012059 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:55.012065 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:55.013465 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.013867 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.013868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.013868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.013925 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.014110 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.014111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.014111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.014278 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:55.014333 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.014483 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.014542 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:40:55.014647 12335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.009180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40055 (local address 127.9.187.194:36971)
0808 17:40:55.009318 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.009327 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.009385 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.009591 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.009592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.009783 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:55.009847 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.009849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.010543 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.010544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.011024 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.011026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.011364 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.011365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.011421 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.011742 (+ 321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:55.011746 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:55.011987 (+ 241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:55.013553 (+ 1566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:55.013554 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:55.013555 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:55.013779 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:55.013987 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:55.013988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:55.013988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:55.014055 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:55.014341 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:55.014342 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:55.014391 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.014456 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.014553 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":74,"threads_started":1}
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:40:55.038421 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40055
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:55.120069 12338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:55.120260 12338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:55.120291 12338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:55.121415 12338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:55.121459 12338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:55.121486 12338 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:40:55.121510 12338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:40:55.123298 12338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.187.254:40055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:55.123535 12338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:55.123760 12338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:55.128468 12348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:55.128594 12338 server_base.cc:1034] running on GCE node
W20260808 17:40:55.128458 12352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:55.128530 12346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:55.128849 12338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:55.129079 12338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:55.130229 12338 hybrid_clock.cc:648] HybridClock initialized: now 1786210855130217 us; error 32 us; skew 500 ppm
Aug 08 17:40:55 dist-test-slave-bqcl krb5kdc[11712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210855, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:55.132617 12338 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:40:55.133033 12338 webserver.cc:460] Webserver started at http://127.9.187.195:35069/ using document root <none> and password file <none>
I20260808 17:40:55.133230 12338 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:55.133270 12338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:55.133361 12338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:55.134364 12338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "b5c91db9abc44c96b193f6c86415de82"
format_stamp: "Formatted at 2026-08-08 17:40:55 on dist-test-slave-bqcl"
server_key: "e434254b0ab1f130eae50ac2eccfdb3b"
server_key_iv: "be30987d2e687117e80ef9d551223ffa"
server_key_version: "encryptionkey@0"
I20260808 17:40:55.134676 12338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "b5c91db9abc44c96b193f6c86415de82"
format_stamp: "Formatted at 2026-08-08 17:40:55 on dist-test-slave-bqcl"
server_key: "e434254b0ab1f130eae50ac2eccfdb3b"
server_key_iv: "be30987d2e687117e80ef9d551223ffa"
server_key_version: "encryptionkey@0"
I20260808 17:40:55.135859 12338 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:55.136565 12363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:55.136739 12338 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:40:55.136823 12338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "b5c91db9abc44c96b193f6c86415de82"
format_stamp: "Formatted at 2026-08-08 17:40:55 on dist-test-slave-bqcl"
server_key: "e434254b0ab1f130eae50ac2eccfdb3b"
server_key_iv: "be30987d2e687117e80ef9d551223ffa"
server_key_version: "encryptionkey@0"
I20260808 17:40:55.136883 12338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:55.155984 12338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:55.158041 12338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:55.158201 12338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:55.158712 12338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:55.158753 12338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:55.158782 12338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:55.158806 12338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 17:40:55 dist-test-slave-bqcl krb5kdc[11712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210855, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:55.166035 12338 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:35239
I20260808 17:40:55.166218 12547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:35239 every 8 connection(s)
I20260808 17:40:55.166453 12338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:40:55.168385 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.159054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:45345 (local address 127.9.187.254:40055)
0808 17:40:55.159115 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.159117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.159325 (+ 208us) server_negotiation.cc:407] Connection header received
0808 17:40:55.159949 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.159950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.159960 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.160001 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:55.160812 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.161561 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.162858 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.163128 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.163180 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.165595 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:55.165596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:55.165597 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:55.165604 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:55.167084 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.167482 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.167483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.167484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.167544 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.167758 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.167759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.167759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.167873 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:55.167928 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.168180 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.168293 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:40:55.168496 12380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.159030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40055 (local address 127.9.187.195:45345)
0808 17:40:55.159188 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.159234 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.159853 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.160086 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.160091 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.160425 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:55.160703 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.160710 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.161653 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.161654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.162771 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.162774 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.163218 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.163219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.163395 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.163873 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:55.163883 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:55.165509 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:55.167187 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:55.167193 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:55.167195 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:55.167414 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:55.167597 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:55.167597 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:55.167598 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:55.167701 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:55.167925 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:55.167931 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:55.168063 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.168150 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.168298 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260808 17:40:55.168924 12548 heartbeater.cc:347] Connected to a master server at 127.9.187.254:40055
I20260808 17:40:55.169008 12548 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:55.169175 12548 heartbeater.cc:511] Master 127.9.187.254:40055 requested a full tablet report, sending...
I20260808 17:40:55.169550 11788 ts_manager.cc:194] Registered new tserver with Master: b5c91db9abc44c96b193f6c86415de82 (127.9.187.195:35239)
I20260808 17:40:55.170018 11788 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:45345
I20260808 17:40:55.173269 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 12338
I20260808 17:40:55.173357 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:40:55.173509 9967 external_mini_cluster.cc:1428] Setting key ce1e0f61209bdb1ac0cf20e8c6e5f111
I20260808 17:40:55.174293 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:40:55.174965 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.169926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:58733 (local address 127.9.187.254:40055)
0808 17:40:55.170169 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.170171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.170179 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:40:55.170198 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.170199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.170209 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.170256 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:55.170614 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.171061 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.171669 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.171841 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.171881 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.172610 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:55.172611 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:55.172611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:55.172617 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:55.173974 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.174319 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.174321 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.174321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.174380 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.174569 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.174569 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.174569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.174664 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:55.174711 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.174855 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.174908 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224}
I20260808 17:40:55.175024 12556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.169859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40055 (local address 127.9.187.195:58733)
0808 17:40:55.169971 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.169981 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.170031 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.170266 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.170267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.170460 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:55.170529 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.170531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.171136 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.171137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.171613 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.171615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.171886 (+ 271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.171886 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.171934 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.172260 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:55.172265 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:55.172544 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:55.174038 (+ 1494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:55.174039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:55.174039 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:55.174245 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:55.174436 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:55.174437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:55.174437 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:55.174509 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:55.174717 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:55.174718 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:55.174766 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.174838 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.174932 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":63,"threads_started":1}
Aug 08 17:40:55 dist-test-slave-bqcl krb5kdc[11712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210855, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 17:40:55 dist-test-slave-bqcl krb5kdc[11712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210855, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:55.197618 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.191635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50548 (local address 127.9.187.254:40055)
0808 17:40:55.191685 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.191686 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.191694 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:40:55.191716 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.191717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.191724 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.191777 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:55.192267 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.192760 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.193428 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.193633 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.193684 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.195655 (+ 1971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:55.195656 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:55.195656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:55.195663 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:55.196839 (+ 1176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.197096 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.197097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.197097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.197141 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.197268 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.197268 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.197268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.197350 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:55.197414 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.197483 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.197554 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:40:55.199143 11788 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:40:55.200676 11788 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:40:55.206992 12574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.202844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:46179 (local address 127.0.0.1:56454)
0808 17:40:55.203163 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.203204 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.203275 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.203446 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.203449 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.203450 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:55.203539 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.203541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.204895 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.204896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.205992 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.205994 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.206688 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.206689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.206780 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.206797 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.206864 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.206916 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":60,"threads_started":1}
I20260808 17:40:55.207069 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.203194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58454 (local address 127.9.187.195:35239)
0808 17:40:55.203365 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.203370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.203574 (+ 204us) server_negotiation.cc:407] Connection header received
0808 17:40:55.203619 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.203621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.203637 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.203718 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:55.203903 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.204594 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.206031 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.206758 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.206824 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.206878 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.206957 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.206987 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":71,"threads_started":1}
I20260808 17:40:55.207414 12579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.203180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37660 (local address 127.9.187.194:44281)
0808 17:40:55.203597 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.203602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.203611 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:40:55.203650 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.203652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.203668 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.203752 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:55.203960 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.204983 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.205988 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.206751 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.206824 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.206877 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.207281 (+ 404us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.207323 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":85,"threads_started":1}
I20260808 17:40:55.207461 12577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.202967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56454 (local address 127.9.187.193:46179)
0808 17:40:55.203185 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.203190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.203253 (+ 63us) server_negotiation.cc:407] Connection header received
0808 17:40:55.203349 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.203352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.203366 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.203433 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:55.203689 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.204815 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.206077 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.206609 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.206676 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.206746 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.207344 (+ 598us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.207382 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":92,"threads_started":1}
I20260808 17:40:55.207113 12578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.202874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:35239 (local address 127.0.0.1:58454)
0808 17:40:55.203353 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.203364 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.203514 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.203784 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.203785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.203787 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:55.203840 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.203841 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.204672 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.204674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.205956 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.205959 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.206823 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.206824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.206889 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.206892 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.206945 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.206978 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":4,"thread_start_us":71,"threads_started":1}
I20260808 17:40:55.207216 12573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.203049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:44281 (local address 127.0.0.1:37660)
0808 17:40:55.203403 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.203412 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.203466 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.203824 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.203825 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.203827 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:55.203893 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.203895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.205050 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.205051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.205917 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.205919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.207020 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.207021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.207081 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.207084 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.207133 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.207165 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":76,"threads_started":1}
I20260808 17:40:55.208283 12019 tablet_service.cc:1467] Processing CreateTablet for tablet 9e870ad005004a0da9a881136983ce69 (DEFAULT_TABLE table=test-table [id=990337bc1578416ebc87f5176054ee08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:55.208280 12441 tablet_service.cc:1467] Processing CreateTablet for tablet 9e870ad005004a0da9a881136983ce69 (DEFAULT_TABLE table=test-table [id=990337bc1578416ebc87f5176054ee08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:55.208370 12228 tablet_service.cc:1467] Processing CreateTablet for tablet 9e870ad005004a0da9a881136983ce69 (DEFAULT_TABLE table=test-table [id=990337bc1578416ebc87f5176054ee08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:55.208630 12228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e870ad005004a0da9a881136983ce69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:55.208632 12019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e870ad005004a0da9a881136983ce69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:55.208632 12441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e870ad005004a0da9a881136983ce69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:55.211426 12582 tablet_bootstrap.cc:492] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: Bootstrap starting.
I20260808 17:40:55.211797 12583 tablet_bootstrap.cc:492] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: Bootstrap starting.
I20260808 17:40:55.212105 12582 tablet_bootstrap.cc:654] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:55.212222 12585 tablet_bootstrap.cc:492] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: Bootstrap starting.
I20260808 17:40:55.212566 12582 log.cc:824] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:55.212687 12583 tablet_bootstrap.cc:654] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:55.212854 12585 tablet_bootstrap.cc:654] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:55.213017 12583 log.cc:824] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:55.213186 12585 log.cc:824] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:55.213393 12582 tablet_bootstrap.cc:492] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: No bootstrap required, opened a new log
I20260808 17:40:55.213512 12582 ts_tablet_manager.cc:1397] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:40:55.213780 12583 tablet_bootstrap.cc:492] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: No bootstrap required, opened a new log
I20260808 17:40:55.213850 12583 ts_tablet_manager.cc:1397] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:40:55.214637 12585 tablet_bootstrap.cc:492] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: No bootstrap required, opened a new log
I20260808 17:40:55.214699 12585 ts_tablet_manager.cc:1397] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 17:40:55.215518 12582 raft_consensus.cc:348] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.215695 12582 raft_consensus.cc:374] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:55.215775 12582 raft_consensus.cc:729] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9ad93f276e48649adda162c3081282, State: Initialized, Role: FOLLOWER
I20260808 17:40:55.215708 12583 raft_consensus.cc:348] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.215884 12583 raft_consensus.cc:374] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:55.215961 12583 raft_consensus.cc:729] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c91db9abc44c96b193f6c86415de82, State: Initialized, Role: FOLLOWER
I20260808 17:40:55.215932 12582 consensus_queue.cc:260] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.216114 12583 consensus_queue.cc:260] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.216202 12582 ts_tablet_manager.cc:1428] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:40:55.216367 12326 heartbeater.cc:503] Master 127.9.187.254:40055 was elected leader, sending a full tablet report...
I20260808 17:40:55.216382 12583 ts_tablet_manager.cc:1428] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:40:55.216409 12548 heartbeater.cc:503] Master 127.9.187.254:40055 was elected leader, sending a full tablet report...
I20260808 17:40:55.216313 12585 raft_consensus.cc:348] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.216468 12585 raft_consensus.cc:374] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:55.216501 12585 raft_consensus.cc:729] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1052dec1bfdc458b9f08d17d446b7894, State: Initialized, Role: FOLLOWER
I20260808 17:40:55.216611 12585 consensus_queue.cc:260] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.217061 12585 ts_tablet_manager.cc:1428] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:40:55.217094 12125 heartbeater.cc:503] Master 127.9.187.254:40055 was elected leader, sending a full tablet report...
W20260808 17:40:55.254909 12328 tablet.cc:2369] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:40:55.358464 12127 tablet.cc:2369] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:40:55.408314 12591 raft_consensus.cc:482] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:40:55.408440 12591 raft_consensus.cc:504] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.408813 12591 leader_election.cc:288] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1052dec1bfdc458b9f08d17d446b7894 (127.9.187.193:46179), ba9ad93f276e48649adda162c3081282 (127.9.187.194:44281)
I20260808 17:40:55.411716 12380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.409006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:46179 (local address 127.9.187.195:39411)
0808 17:40:55.409061 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.409073 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.409118 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.409291 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.409292 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.409294 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:55.409366 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.409368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.410061 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.410062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.410871 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.410874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.411454 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.411455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.411550 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.411555 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.411605 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.411640 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 17:40:55.411763 12577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.409071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:39411 (local address 127.9.187.193:46179)
0808 17:40:55.409127 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.409129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.409141 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:40:55.409174 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.409175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.409184 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.409255 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:55.409445 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.409981 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.410975 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.411382 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.411436 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.411443 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.411639 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.411689 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:40:55.411877 12595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.409109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:44281 (local address 127.9.187.195:60621)
0808 17:40:55.409285 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.409296 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.409352 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.409462 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.409463 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.409465 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:55.409555 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.409557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.410198 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.410198 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.411028 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.411031 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.411635 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.411636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.411711 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.411715 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.411775 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.411809 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":113,"threads_started":1}
I20260808 17:40:55.411900 12579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.409231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:60621 (local address 127.9.187.194:44281)
0808 17:40:55.409275 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.409277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.409357 (+ 80us) server_negotiation.cc:407] Connection header received
0808 17:40:55.409391 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.409392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.409400 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.409453 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:55.409616 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.410090 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.411116 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.411527 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.411619 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.411626 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.411790 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.411835 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:40:55.412279 12052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e870ad005004a0da9a881136983ce69" candidate_uuid: "b5c91db9abc44c96b193f6c86415de82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1052dec1bfdc458b9f08d17d446b7894" is_pre_election: true
I20260808 17:40:55.412285 12267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e870ad005004a0da9a881136983ce69" candidate_uuid: "b5c91db9abc44c96b193f6c86415de82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9ad93f276e48649adda162c3081282" is_pre_election: true
I20260808 17:40:55.412441 12267 raft_consensus.cc:2454] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5c91db9abc44c96b193f6c86415de82 in term 0.
I20260808 17:40:55.412441 12052 raft_consensus.cc:2454] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5c91db9abc44c96b193f6c86415de82 in term 0.
I20260808 17:40:55.412673 12364 leader_election.cc:302] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5c91db9abc44c96b193f6c86415de82, ba9ad93f276e48649adda162c3081282; no voters:
I20260808 17:40:55.412796 12591 raft_consensus.cc:2781] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:40:55.412855 12591 raft_consensus.cc:482] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:40:55.412882 12591 raft_consensus.cc:3037] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:55.413637 12591 raft_consensus.cc:504] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.413757 12591 leader_election.cc:288] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [CANDIDATE]: Term 1 election: Requested vote from peers 1052dec1bfdc458b9f08d17d446b7894 (127.9.187.193:46179), ba9ad93f276e48649adda162c3081282 (127.9.187.194:44281)
I20260808 17:40:55.413929 12052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e870ad005004a0da9a881136983ce69" candidate_uuid: "b5c91db9abc44c96b193f6c86415de82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1052dec1bfdc458b9f08d17d446b7894"
I20260808 17:40:55.413936 12267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e870ad005004a0da9a881136983ce69" candidate_uuid: "b5c91db9abc44c96b193f6c86415de82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9ad93f276e48649adda162c3081282"
I20260808 17:40:55.414011 12052 raft_consensus.cc:3037] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:55.414013 12267 raft_consensus.cc:3037] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:55.414772 12052 raft_consensus.cc:2454] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5c91db9abc44c96b193f6c86415de82 in term 1.
I20260808 17:40:55.414777 12267 raft_consensus.cc:2454] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5c91db9abc44c96b193f6c86415de82 in term 1.
I20260808 17:40:55.414934 12364 leader_election.cc:302] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5c91db9abc44c96b193f6c86415de82, ba9ad93f276e48649adda162c3081282; no voters:
I20260808 17:40:55.415019 12591 raft_consensus.cc:2781] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:55.415169 12591 raft_consensus.cc:686] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 1 LEADER]: Becoming Leader. State: Replica: b5c91db9abc44c96b193f6c86415de82, State: Running, Role: LEADER
I20260808 17:40:55.415268 12591 consensus_queue.cc:237] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.416081 11788 catalog_manager.cc:5495] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5c91db9abc44c96b193f6c86415de82 (127.9.187.195). New cstate: current_term: 1 leader_uuid: "b5c91db9abc44c96b193f6c86415de82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } health_report { overall_health: HEALTHY } } }
W20260808 17:40:55.417287 12550 tablet.cc:2369] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:40:55.436343 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.434098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58462 (local address 127.9.187.195:35239)
0808 17:40:55.434167 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.434169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.434197 (+ 28us) server_negotiation.cc:407] Connection header received
0808 17:40:55.434383 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.434384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.434400 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.434462 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:40:55.434578 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.435037 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.435732 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.435904 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.435946 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.436087 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:40:55.436171 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:40:55.436224 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.436260 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.436275 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 17:40:55.438056 12267 raft_consensus.cc:1261] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282 [term 1 FOLLOWER]: Refusing update from remote peer b5c91db9abc44c96b193f6c86415de82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:55.438076 12052 raft_consensus.cc:1261] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 FOLLOWER]: Refusing update from remote peer b5c91db9abc44c96b193f6c86415de82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:55.438421 12591 consensus_queue.cc:1035] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:55.440287 12591 consensus_queue.cc:1035] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:55.440902 12599 mvcc.cc:205] Tried to move back new op lower bound from 7316319663871352832 to 7316319663781535744. Current Snapshot: MvccSnapshot[applied={T|T < 7316319663871352832}]
I20260808 17:40:55.442750 12604 mvcc.cc:205] Tried to move back new op lower bound from 7316319663871352832 to 7316319663781535744. Current Snapshot: MvccSnapshot[applied={T|T < 7316319663871352832}]
I20260808 17:40:55.445487 11788 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:40:55.445600 11788 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:40:55.446471 11788 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a: Sending DeleteTablet for 3 replicas of tablet 9e870ad005004a0da9a881136983ce69
I20260808 17:40:55.446929 12441 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e870ad005004a0da9a881136983ce69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:55 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:58454
I20260808 17:40:55.447127 12614 tablet_replica.cc:330] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: stopping tablet replica
I20260808 17:40:55.447202 12614 raft_consensus.cc:2229] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:40:55.447285 12614 raft_consensus.cc:2258] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:55.448599 12019 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e870ad005004a0da9a881136983ce69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:55 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:56454
I20260808 17:40:55.448779 12228 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e870ad005004a0da9a881136983ce69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:55 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:37660
I20260808 17:40:55.448945 12615 tablet_replica.cc:330] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: stopping tablet replica
I20260808 17:40:55.449061 12615 raft_consensus.cc:2229] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:40:55.449179 12615 raft_consensus.cc:2258] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:55.449330 12614 ts_tablet_manager.cc:1905] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:55.449396 11788 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:40:55.449538 11788 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:40:55.449628 12615 ts_tablet_manager.cc:1905] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:55.450902 12441 tablet_service.cc:1467] Processing CreateTablet for tablet e5b52402337b4cb5988395e991f00762 (DEFAULT_TABLE table=test-table [id=835587a6110a4bbeb3b0167cba3cce70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:55.450997 12614 ts_tablet_manager.cc:1918] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:40:55.451012 12441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5b52402337b4cb5988395e991f00762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:55.451066 12614 log.cc:1196] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/9e870ad005004a0da9a881136983ce69
I20260808 17:40:55.451244 12615 ts_tablet_manager.cc:1918] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:40:55.451305 12615 log.cc:1196] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/wal/wals/9e870ad005004a0da9a881136983ce69
I20260808 17:40:55.451315 12614 ts_tablet_manager.cc:1939] T 9e870ad005004a0da9a881136983ce69 P b5c91db9abc44c96b193f6c86415de82: Deleting consensus metadata
I20260808 17:40:55.451571 12615 ts_tablet_manager.cc:1939] T 9e870ad005004a0da9a881136983ce69 P 1052dec1bfdc458b9f08d17d446b7894: Deleting consensus metadata
I20260808 17:40:55.452149 12583 tablet_bootstrap.cc:492] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82: Bootstrap starting.
I20260808 17:40:55.452226 11767 catalog_manager.cc:4841] TS b5c91db9abc44c96b193f6c86415de82 (127.9.187.195:35239): tablet 9e870ad005004a0da9a881136983ce69 (table test-table [id=990337bc1578416ebc87f5176054ee08]) successfully deleted
I20260808 17:40:55.452569 12583 tablet_bootstrap.cc:654] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:55.452601 11764 catalog_manager.cc:4841] TS 1052dec1bfdc458b9f08d17d446b7894 (127.9.187.193:46179): tablet 9e870ad005004a0da9a881136983ce69 (table test-table [id=990337bc1578416ebc87f5176054ee08]) successfully deleted
I20260808 17:40:55.452665 12019 tablet_service.cc:1467] Processing CreateTablet for tablet e5b52402337b4cb5988395e991f00762 (DEFAULT_TABLE table=test-table [id=835587a6110a4bbeb3b0167cba3cce70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:55.452772 12019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5b52402337b4cb5988395e991f00762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:55.453275 12583 tablet_bootstrap.cc:492] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82: No bootstrap required, opened a new log
I20260808 17:40:55.453325 12583 ts_tablet_manager.cc:1397] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:55.453349 12228 tablet_service.cc:1467] Processing CreateTablet for tablet e5b52402337b4cb5988395e991f00762 (DEFAULT_TABLE table=test-table [id=835587a6110a4bbeb3b0167cba3cce70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:55.453451 12228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5b52402337b4cb5988395e991f00762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:55.453601 12583 raft_consensus.cc:348] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.453661 12583 raft_consensus.cc:374] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:55.453676 12583 raft_consensus.cc:729] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c91db9abc44c96b193f6c86415de82, State: Initialized, Role: FOLLOWER
I20260808 17:40:55.453712 12583 consensus_queue.cc:260] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.453790 12583 ts_tablet_manager.cc:1428] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:55.453867 12585 tablet_bootstrap.cc:492] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894: Bootstrap starting.
I20260808 17:40:55.454269 12585 tablet_bootstrap.cc:654] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:55.454444 12617 tablet_replica.cc:330] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: stopping tablet replica
I20260808 17:40:55.454542 12617 raft_consensus.cc:2229] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:40:55.454650 12617 raft_consensus.cc:2258] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:55.454941 12585 tablet_bootstrap.cc:492] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894: No bootstrap required, opened a new log
I20260808 17:40:55.454993 12585 ts_tablet_manager.cc:1397] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:55.455137 12617 ts_tablet_manager.cc:1905] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:55.455138 12585 raft_consensus.cc:348] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.455207 12585 raft_consensus.cc:374] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:55.455226 12585 raft_consensus.cc:729] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1052dec1bfdc458b9f08d17d446b7894, State: Initialized, Role: FOLLOWER
I20260808 17:40:55.455236 12582 tablet_bootstrap.cc:492] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282: Bootstrap starting.
I20260808 17:40:55.455267 12585 consensus_queue.cc:260] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.455410 12585 ts_tablet_manager.cc:1428] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:55.455749 12582 tablet_bootstrap.cc:654] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:55.456604 12617 ts_tablet_manager.cc:1918] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:40:55.456704 12617 log.cc:1196] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/9e870ad005004a0da9a881136983ce69
I20260808 17:40:55.456975 12617 ts_tablet_manager.cc:1939] T 9e870ad005004a0da9a881136983ce69 P ba9ad93f276e48649adda162c3081282: Deleting consensus metadata
I20260808 17:40:55.456981 12582 tablet_bootstrap.cc:492] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282: No bootstrap required, opened a new log
I20260808 17:40:55.457101 12582 ts_tablet_manager.cc:1397] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:40:55.457376 11764 catalog_manager.cc:4841] TS ba9ad93f276e48649adda162c3081282 (127.9.187.194:44281): tablet 9e870ad005004a0da9a881136983ce69 (table test-table [id=990337bc1578416ebc87f5176054ee08]) successfully deleted
I20260808 17:40:55.457345 12582 raft_consensus.cc:348] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.457417 12582 raft_consensus.cc:374] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:55.457435 12582 raft_consensus.cc:729] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9ad93f276e48649adda162c3081282, State: Initialized, Role: FOLLOWER
I20260808 17:40:55.457474 12582 consensus_queue.cc:260] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.457551 12582 ts_tablet_manager.cc:1428] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:55.511904 12590 raft_consensus.cc:482] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:40:55.511997 12590 raft_consensus.cc:504] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.512286 12590 leader_election.cc:288] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1052dec1bfdc458b9f08d17d446b7894 (127.9.187.193:46179), b5c91db9abc44c96b193f6c86415de82 (127.9.187.195:35239)
I20260808 17:40:55.514560 12593 raft_consensus.cc:482] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:40:55.514639 12593 raft_consensus.cc:504] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.514935 12593 leader_election.cc:288] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba9ad93f276e48649adda162c3081282 (127.9.187.194:44281), b5c91db9abc44c96b193f6c86415de82 (127.9.187.195:35239)
I20260808 17:40:55.516003 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.512496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:57669 (local address 127.9.187.195:35239)
0808 17:40:55.512615 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.512617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.512628 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:40:55.512676 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.512677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.512687 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.512733 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:55.512937 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.513665 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.515112 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.515626 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.515676 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.515686 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.515899 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.515937 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 17:40:55.516637 12577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.512704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:42667 (local address 127.9.187.193:46179)
0808 17:40:55.512757 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.512759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.512766 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:40:55.512788 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.512789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.512798 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.512850 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:55.513024 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.513743 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.515456 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.515981 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.516041 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.516049 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.516531 (+ 482us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.516574 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:40:55.516999 12622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.512442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:46179 (local address 127.9.187.194:42667)
0808 17:40:55.512557 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.512568 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.512620 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.512870 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.512871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.512874 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:55.512943 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.512945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.513820 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.513821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.514717 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.514720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.516369 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.516370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.516441 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.516445 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.516881 (+ 436us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.516925 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":64,"threads_started":1}
I20260808 17:40:55.517370 12052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5b52402337b4cb5988395e991f00762" candidate_uuid: "ba9ad93f276e48649adda162c3081282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1052dec1bfdc458b9f08d17d446b7894" is_pre_election: true
I20260808 17:40:55.517448 12052 raft_consensus.cc:2454] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba9ad93f276e48649adda162c3081282 in term 0.
I20260808 17:40:55.517668 12159 leader_election.cc:302] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1052dec1bfdc458b9f08d17d446b7894, ba9ad93f276e48649adda162c3081282; no voters:
I20260808 17:40:55.517793 12590 raft_consensus.cc:2781] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:40:55.517825 12590 raft_consensus.cc:482] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:40:55.517843 12590 raft_consensus.cc:3037] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:55.518702 12590 raft_consensus.cc:504] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.518832 12626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.515089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:44281 (local address 127.9.187.193:56439)
0808 17:40:55.515534 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.515542 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.515598 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.515737 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.515738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.515740 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:55.515802 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.515804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.516559 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.516559 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.517743 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.517746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.518510 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.518511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.518575 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.518579 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.518720 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.518755 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":2,"spinlock_wait_cycles":1792,"thread_start_us":104,"threads_started":1}
I20260808 17:40:55.518833 12590 leader_election.cc:288] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [CANDIDATE]: Term 1 election: Requested vote from peers 1052dec1bfdc458b9f08d17d446b7894 (127.9.187.193:46179), b5c91db9abc44c96b193f6c86415de82 (127.9.187.195:35239)
I20260808 17:40:55.519114 12579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.515388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:56439 (local address 127.9.187.194:44281)
0808 17:40:55.515426 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.515427 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.515579 (+ 152us) server_negotiation.cc:407] Connection header received
0808 17:40:55.515657 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.515658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.515666 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.515691 (+ 25us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:55.515865 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.516474 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.517838 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.518359 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.518407 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.518414 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.518656 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.518691 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:40:55.519158 12052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5b52402337b4cb5988395e991f00762" candidate_uuid: "ba9ad93f276e48649adda162c3081282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1052dec1bfdc458b9f08d17d446b7894"
I20260808 17:40:55.519215 12052 raft_consensus.cc:3037] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:55.519245 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.515275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:44785 (local address 127.9.187.195:35239)
0808 17:40:55.516102 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.516103 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.516111 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:40:55.516129 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.516129 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.516137 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.516186 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:55.516383 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.517011 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.518357 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.518859 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.518907 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.518914 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.519146 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.519181 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":815,"thread_start_us":60,"threads_started":1}
I20260808 17:40:55.519430 12267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5b52402337b4cb5988395e991f00762" candidate_uuid: "1052dec1bfdc458b9f08d17d446b7894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9ad93f276e48649adda162c3081282" is_pre_election: true
I20260808 17:40:55.519506 12267 raft_consensus.cc:2379] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1052dec1bfdc458b9f08d17d446b7894 in current term 1: Already voted for candidate ba9ad93f276e48649adda162c3081282 in this term.
I20260808 17:40:55.519510 12625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.515090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:35239 (local address 127.9.187.193:44785)
0808 17:40:55.515383 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.515393 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.515446 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.516229 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.516231 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.516232 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:55.516305 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.516307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.517123 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.517124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.518254 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.518257 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.518974 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.518975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.519057 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.519060 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.519393 (+ 333us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.519433 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":81,"threads_started":1}
I20260808 17:40:55.519965 12052 raft_consensus.cc:2454] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba9ad93f276e48649adda162c3081282 in term 1.
I20260808 17:40:55.519966 12475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5b52402337b4cb5988395e991f00762" candidate_uuid: "1052dec1bfdc458b9f08d17d446b7894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c91db9abc44c96b193f6c86415de82" is_pre_election: true
I20260808 17:40:55.520061 12623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.512436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:35239 (local address 127.9.187.194:57669)
0808 17:40:55.512557 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.512568 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.512620 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.512751 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.512752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.512754 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:55.512832 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.512834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.513754 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.513755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.514993 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.514996 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.515749 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.515750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.515817 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.515821 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.519931 (+ 4110us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.519978 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":14,"thread_start_us":62,"threads_started":1}
I20260808 17:40:55.520112 12159 leader_election.cc:302] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1052dec1bfdc458b9f08d17d446b7894, ba9ad93f276e48649adda162c3081282; no voters:
I20260808 17:40:55.520108 12475 raft_consensus.cc:2454] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1052dec1bfdc458b9f08d17d446b7894 in term 0.
I20260808 17:40:55.520179 12590 raft_consensus.cc:2781] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:55.520254 12590 raft_consensus.cc:686] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 1 LEADER]: Becoming Leader. State: Replica: ba9ad93f276e48649adda162c3081282, State: Running, Role: LEADER
I20260808 17:40:55.520313 12590 consensus_queue.cc:237] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.520365 11936 leader_election.cc:302] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1052dec1bfdc458b9f08d17d446b7894, b5c91db9abc44c96b193f6c86415de82; no voters: ba9ad93f276e48649adda162c3081282
I20260808 17:40:55.520525 12593 raft_consensus.cc:2741] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260808 17:40:55.520673 12474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5b52402337b4cb5988395e991f00762" candidate_uuid: "ba9ad93f276e48649adda162c3081282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c91db9abc44c96b193f6c86415de82"
I20260808 17:40:55.520768 12474 raft_consensus.cc:3037] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:55.520825 12475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5b52402337b4cb5988395e991f00762" candidate_uuid: "ba9ad93f276e48649adda162c3081282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c91db9abc44c96b193f6c86415de82" is_pre_election: true
I20260808 17:40:55.520987 11788 catalog_manager.cc:5495] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba9ad93f276e48649adda162c3081282 (127.9.187.194). New cstate: current_term: 1 leader_uuid: "ba9ad93f276e48649adda162c3081282" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260808 17:40:55.521720 12474 raft_consensus.cc:2454] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba9ad93f276e48649adda162c3081282 in term 1.
Aug 08 17:40:55 dist-test-slave-bqcl krb5kdc[11712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:55.558670 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.550994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50554 (local address 127.9.187.254:40055)
0808 17:40:55.551058 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.551060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.551245 (+ 185us) server_negotiation.cc:407] Connection header received
0808 17:40:55.551293 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.551294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.551306 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.551377 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:55.551934 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.552707 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.553454 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.553744 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.553823 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.556159 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:55.556161 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:55.556161 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:55.556169 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:55.557588 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.557930 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.557931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.557931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.557987 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.558159 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.558159 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.558160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.558279 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:55.558332 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.558458 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.558574 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":35}
I20260808 17:40:55.558691 12641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.550937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40055 (local address 127.0.0.1:50554)
0808 17:40:55.551170 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.551181 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.551245 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.551392 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.551393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.551773 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:55.551850 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.551852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.552788 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.552789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.553364 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.553366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.553819 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.553820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.553856 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.554453 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:55.554458 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:55.556066 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:55.557661 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:55.557669 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:55.557670 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:55.557868 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:55.558045 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:55.558046 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:55.558046 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:55.558096 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:55.558333 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:55.558339 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:55.558380 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.558424 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.558516 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":112,"threads_started":1}
I20260808 17:40:55.561116 11788 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:50554:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 17:40:55.561520 11788 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:40:55.562968 12441 tablet_service.cc:1467] Processing CreateTablet for tablet 04b53acbe55940aab018272a57b2ed42 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=192ead5bef7444b3b908b281c53037d2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:40:55.563050 12228 tablet_service.cc:1467] Processing CreateTablet for tablet 04b53acbe55940aab018272a57b2ed42 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=192ead5bef7444b3b908b281c53037d2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:40:55.563198 12441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b53acbe55940aab018272a57b2ed42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:55.563197 12228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b53acbe55940aab018272a57b2ed42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:55.563162 12019 tablet_service.cc:1467] Processing CreateTablet for tablet 04b53acbe55940aab018272a57b2ed42 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=192ead5bef7444b3b908b281c53037d2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:40:55.563339 12019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b53acbe55940aab018272a57b2ed42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:55.565003 12582 tablet_bootstrap.cc:492] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282: Bootstrap starting.
I20260808 17:40:55.565060 12583 tablet_bootstrap.cc:492] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82: Bootstrap starting.
I20260808 17:40:55.565097 12585 tablet_bootstrap.cc:492] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: Bootstrap starting.
I20260808 17:40:55.565456 12583 tablet_bootstrap.cc:654] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:55.565830 12582 tablet_bootstrap.cc:654] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:55.565837 12585 tablet_bootstrap.cc:654] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:55.566327 12583 tablet_bootstrap.cc:492] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82: No bootstrap required, opened a new log
I20260808 17:40:55.566380 12583 ts_tablet_manager.cc:1397] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:55.566478 12583 raft_consensus.cc:348] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.566555 12583 raft_consensus.cc:374] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:55.566574 12583 raft_consensus.cc:729] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c91db9abc44c96b193f6c86415de82, State: Initialized, Role: FOLLOWER
I20260808 17:40:55.566617 12583 consensus_queue.cc:260] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.566702 12583 ts_tablet_manager.cc:1428] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:55.566828 12611 tablet_replica.cc:439] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } } }
I20260808 17:40:55.566905 12611 tablet_replica.cc:442] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:55.567008 12585 tablet_bootstrap.cc:492] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: No bootstrap required, opened a new log
I20260808 17:40:55.567052 12585 ts_tablet_manager.cc:1397] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:40:55.567219 12582 tablet_bootstrap.cc:492] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282: No bootstrap required, opened a new log
I20260808 17:40:55.567260 12582 ts_tablet_manager.cc:1397] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:40:55.567214 12585 raft_consensus.cc:348] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.567313 12585 raft_consensus.cc:374] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:55.567339 12585 raft_consensus.cc:729] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1052dec1bfdc458b9f08d17d446b7894, State: Initialized, Role: FOLLOWER
I20260808 17:40:55.567382 12585 consensus_queue.cc:260] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.567399 12582 raft_consensus.cc:348] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.567461 12582 raft_consensus.cc:374] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:55.567480 12582 raft_consensus.cc:729] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9ad93f276e48649adda162c3081282, State: Initialized, Role: FOLLOWER
I20260808 17:40:55.567466 12585 ts_tablet_manager.cc:1428] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:40:55.567517 12582 consensus_queue.cc:260] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.567595 12582 ts_tablet_manager.cc:1428] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:55.567610 12593 tablet_replica.cc:439] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } } }
I20260808 17:40:55.567683 12593 tablet_replica.cc:442] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:55.567723 12631 tablet_replica.cc:439] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } } }
I20260808 17:40:55.567837 12631 tablet_replica.cc:442] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:55.693583 12593 raft_consensus.cc:482] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:40:55.693682 12593 raft_consensus.cc:504] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.693848 12593 leader_election.cc:288] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba9ad93f276e48649adda162c3081282 (127.9.187.194:44281), b5c91db9abc44c96b193f6c86415de82 (127.9.187.195:35239)
I20260808 17:40:55.694056 12474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b53acbe55940aab018272a57b2ed42" candidate_uuid: "1052dec1bfdc458b9f08d17d446b7894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c91db9abc44c96b193f6c86415de82" is_pre_election: true
I20260808 17:40:55.694188 12474 raft_consensus.cc:2454] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1052dec1bfdc458b9f08d17d446b7894 in term 0.
I20260808 17:40:55.694233 12267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b53acbe55940aab018272a57b2ed42" candidate_uuid: "1052dec1bfdc458b9f08d17d446b7894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9ad93f276e48649adda162c3081282" is_pre_election: true
I20260808 17:40:55.694342 12267 raft_consensus.cc:2454] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1052dec1bfdc458b9f08d17d446b7894 in term 0.
I20260808 17:40:55.694367 11936 leader_election.cc:302] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1052dec1bfdc458b9f08d17d446b7894, b5c91db9abc44c96b193f6c86415de82; no voters:
I20260808 17:40:55.694486 12593 raft_consensus.cc:2781] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:40:55.694536 12593 raft_consensus.cc:482] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:40:55.694552 12593 raft_consensus.cc:3037] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:55.695536 12593 raft_consensus.cc:504] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.695662 12593 leader_election.cc:288] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [CANDIDATE]: Term 1 election: Requested vote from peers ba9ad93f276e48649adda162c3081282 (127.9.187.194:44281), b5c91db9abc44c96b193f6c86415de82 (127.9.187.195:35239)
I20260808 17:40:55.695804 12474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b53acbe55940aab018272a57b2ed42" candidate_uuid: "1052dec1bfdc458b9f08d17d446b7894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c91db9abc44c96b193f6c86415de82"
I20260808 17:40:55.695824 12267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b53acbe55940aab018272a57b2ed42" candidate_uuid: "1052dec1bfdc458b9f08d17d446b7894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9ad93f276e48649adda162c3081282"
I20260808 17:40:55.695876 12474 raft_consensus.cc:3037] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:55.695889 12267 raft_consensus.cc:3037] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:55.696561 12267 raft_consensus.cc:2454] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1052dec1bfdc458b9f08d17d446b7894 in term 1.
I20260808 17:40:55.696597 12474 raft_consensus.cc:2454] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1052dec1bfdc458b9f08d17d446b7894 in term 1.
I20260808 17:40:55.696748 11934 leader_election.cc:302] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1052dec1bfdc458b9f08d17d446b7894, ba9ad93f276e48649adda162c3081282; no voters:
I20260808 17:40:55.696875 12593 raft_consensus.cc:2781] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:55.697075 12593 raft_consensus.cc:686] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 LEADER]: Becoming Leader. State: Replica: 1052dec1bfdc458b9f08d17d446b7894, State: Running, Role: LEADER
I20260808 17:40:55.697150 12593 consensus_queue.cc:237] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } }
I20260808 17:40:55.697661 12648 tablet_replica.cc:439] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: TxnStatusTablet state changed. Reason: New leader 1052dec1bfdc458b9f08d17d446b7894. Latest consensus state: current_term: 1 leader_uuid: "1052dec1bfdc458b9f08d17d446b7894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } } }
I20260808 17:40:55.697757 12648 tablet_replica.cc:442] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:40:55.698092 12650 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 17:40:55.698071 11788 catalog_manager.cc:5495] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1052dec1bfdc458b9f08d17d446b7894 (127.9.187.193). New cstate: current_term: 1 leader_uuid: "1052dec1bfdc458b9f08d17d446b7894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260808 17:40:55.698275 12650 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 17:40:55.712493 12641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.710089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:46179 (local address 127.0.0.1:47944)
0808 17:40:55.710171 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.710182 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.710242 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.710393 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.710394 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.710395 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:40:55.710445 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.710447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.711086 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.711087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.711658 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.711660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.711996 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.711997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.712066 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.712080 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:40:55.712320 (+ 240us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:40:55.712329 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.712372 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.712426 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 17:40:55.712579 12577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.710112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47944 (local address 127.9.187.193:46179)
0808 17:40:55.710171 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.710173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.710244 (+ 71us) server_negotiation.cc:407] Connection header received
0808 17:40:55.710320 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.710321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.710338 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.710391 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:40:55.710499 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.711009 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.711732 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.711937 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.711989 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.712160 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:40:55.712264 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:40:55.712325 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.712374 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.712396 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 17:40:55.713871 12267 raft_consensus.cc:1261] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282 [term 1 FOLLOWER]: Refusing update from remote peer 1052dec1bfdc458b9f08d17d446b7894: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:55.713949 12474 raft_consensus.cc:1261] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82 [term 1 FOLLOWER]: Refusing update from remote peer 1052dec1bfdc458b9f08d17d446b7894: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:55.714071 12593 consensus_queue.cc:1035] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:55.714291 12648 consensus_queue.cc:1035] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:55.714742 12631 tablet_replica.cc:439] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282: TxnStatusTablet state changed. Reason: New leader 1052dec1bfdc458b9f08d17d446b7894. Latest consensus state: current_term: 1 leader_uuid: "1052dec1bfdc458b9f08d17d446b7894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } } }
I20260808 17:40:55.714829 12631 tablet_replica.cc:442] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:55.714895 12611 tablet_replica.cc:439] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82: TxnStatusTablet state changed. Reason: New leader 1052dec1bfdc458b9f08d17d446b7894. Latest consensus state: current_term: 1 leader_uuid: "1052dec1bfdc458b9f08d17d446b7894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } } }
I20260808 17:40:55.714987 12611 tablet_replica.cc:442] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:55.715708 12593 tablet_replica.cc:439] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1052dec1bfdc458b9f08d17d446b7894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } } }
I20260808 17:40:55.715781 12593 tablet_replica.cc:442] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:40:55.715754 12648 tablet_replica.cc:439] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1052dec1bfdc458b9f08d17d446b7894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } } }
I20260808 17:40:55.715842 12648 tablet_replica.cc:442] T 04b53acbe55940aab018272a57b2ed42 P 1052dec1bfdc458b9f08d17d446b7894: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:40:55.716030 12611 tablet_replica.cc:439] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1052dec1bfdc458b9f08d17d446b7894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } } }
I20260808 17:40:55.716118 12611 tablet_replica.cc:442] T 04b53acbe55940aab018272a57b2ed42 P b5c91db9abc44c96b193f6c86415de82: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:55.716889 12600 mvcc.cc:205] Tried to move back new op lower bound from 7316319665001959424 to 7316319664936161280. Current Snapshot: MvccSnapshot[applied={T|T < 7316319665001959424}]
I20260808 17:40:55.717070 12631 tablet_replica.cc:439] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1052dec1bfdc458b9f08d17d446b7894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 } } peers { permanent_uuid: "ba9ad93f276e48649adda162c3081282" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 44281 } } peers { permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 } } }
I20260808 17:40:55.717159 12631 tablet_replica.cc:442] T 04b53acbe55940aab018272a57b2ed42 P ba9ad93f276e48649adda162c3081282: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:55.720047 12579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.717903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57832 (local address 127.9.187.194:44281)
0808 17:40:55.717947 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.717949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.717957 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:40:55.718007 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.718008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.718027 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.718086 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:40:55.718234 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.718677 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.719366 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.719565 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.719617 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.719766 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:40:55.719858 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:40:55.719916 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.719965 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.719985 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:40:55.724905 12577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.722358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:35965 (local address 127.9.187.193:46179)
0808 17:40:55.722447 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.722449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.722571 (+ 122us) server_negotiation.cc:407] Connection header received
0808 17:40:55.722621 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.722621 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.722630 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.722678 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:40:55.722864 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.723304 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.724227 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.724425 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.724477 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.724702 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:40:55.724734 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:40:55.724777 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.724826 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.724844 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:40:55.725063 12663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.722298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:46179 (local address 127.9.187.194:35965)
0808 17:40:55.722505 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.722514 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.722567 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.722683 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.722684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.722685 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:40:55.722803 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.722804 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.723370 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.723371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.724149 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.724151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.724569 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.724571 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.724614 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.724628 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:40:55.724784 (+ 156us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:40:55.724786 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.724825 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.724865 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":81,"threads_started":1}
I20260808 17:40:55.727433 12052 raft_consensus.cc:1261] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 FOLLOWER]: Refusing update from remote peer ba9ad93f276e48649adda162c3081282: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:55.727509 12474 raft_consensus.cc:1261] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82 [term 1 FOLLOWER]: Refusing update from remote peer ba9ad93f276e48649adda162c3081282: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:55.727614 12590 consensus_queue.cc:1035] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1052dec1bfdc458b9f08d17d446b7894" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 46179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:55.727742 12631 consensus_queue.cc:1035] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c91db9abc44c96b193f6c86415de82" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:55.736444 12579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.733282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:40723 (local address 127.9.187.194:44281)
0808 17:40:55.733322 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.733324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.733473 (+ 149us) server_negotiation.cc:407] Connection header received
0808 17:40:55.733516 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.733517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.733525 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.733574 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:40:55.733710 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.734204 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.735741 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.735991 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.736029 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.736242 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:40:55.736273 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:40:55.736314 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.736365 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.736383 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:40:55.736486 12668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.733251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:44281 (local address 127.9.187.193:40723)
0808 17:40:55.733406 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:55.733415 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:55.733472 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:55.733578 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:55.733579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:55.733580 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:40:55.733634 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.733635 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.734283 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.734284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.735645 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:55.735648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.736084 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.736085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:55.736147 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.736162 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:40:55.736322 (+ 160us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:40:55.736325 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:40:55.736364 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 17:40:55.736404 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":96,"threads_started":1}
I20260808 17:40:55.746212 11786 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:40:55.746310 11786 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:40:55.746932 11786 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 715c337dfeef443ba06ee584bc96f57a: Sending DeleteTablet for 3 replicas of tablet e5b52402337b4cb5988395e991f00762
I20260808 17:40:55.747174 12441 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b52402337b4cb5988395e991f00762 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:55 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:58454
I20260808 17:40:55.747253 12228 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b52402337b4cb5988395e991f00762 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:55 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:37660
I20260808 17:40:55.747349 12614 tablet_replica.cc:330] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82: stopping tablet replica
I20260808 17:40:55.747354 12617 tablet_replica.cc:330] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282: stopping tablet replica
I20260808 17:40:55.747402 12614 raft_consensus.cc:2229] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:40:55.747412 12617 raft_consensus.cc:2229] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:40:55.747435 12614 raft_consensus.cc:2258] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:55.747479 12617 raft_consensus.cc:2258] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:55.747779 12614 ts_tablet_manager.cc:1905] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:55.747849 12617 ts_tablet_manager.cc:1905] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:55.749461 12614 ts_tablet_manager.cc:1918] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:40:55.749512 12614 log.cc:1196] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/e5b52402337b4cb5988395e991f00762
I20260808 17:40:55.749578 12617 ts_tablet_manager.cc:1918] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:40:55.749629 12617 log.cc:1196] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/e5b52402337b4cb5988395e991f00762
I20260808 17:40:55.749728 12614 ts_tablet_manager.cc:1939] T e5b52402337b4cb5988395e991f00762 P b5c91db9abc44c96b193f6c86415de82: Deleting consensus metadata
I20260808 17:40:55.749846 12617 ts_tablet_manager.cc:1939] T e5b52402337b4cb5988395e991f00762 P ba9ad93f276e48649adda162c3081282: Deleting consensus metadata
I20260808 17:40:55.750098 12019 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b52402337b4cb5988395e991f00762 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:55 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:56454
I20260808 17:40:55.750207 12615 tablet_replica.cc:330] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894: stopping tablet replica
I20260808 17:40:55.750250 12615 raft_consensus.cc:2229] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:40:55.750281 12615 raft_consensus.cc:2258] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:55.750430 11764 catalog_manager.cc:4841] TS ba9ad93f276e48649adda162c3081282 (127.9.187.194:44281): tablet e5b52402337b4cb5988395e991f00762 (table test-table [id=835587a6110a4bbeb3b0167cba3cce70]) successfully deleted
I20260808 17:40:55.750769 11767 catalog_manager.cc:4841] TS b5c91db9abc44c96b193f6c86415de82 (127.9.187.195:35239): tablet e5b52402337b4cb5988395e991f00762 (table test-table [id=835587a6110a4bbeb3b0167cba3cce70]) successfully deleted
I20260808 17:40:55.751037 12615 ts_tablet_manager.cc:1905] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:55.752633 12615 ts_tablet_manager.cc:1918] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:40:55.752681 12615 log.cc:1196] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786210848752357-9967-0/minicluster-data/ts-0/wal/wals/e5b52402337b4cb5988395e991f00762
I20260808 17:40:55.752884 12615 ts_tablet_manager.cc:1939] T e5b52402337b4cb5988395e991f00762 P 1052dec1bfdc458b9f08d17d446b7894: Deleting consensus metadata
I20260808 17:40:55.753191 11764 catalog_manager.cc:4841] TS 1052dec1bfdc458b9f08d17d446b7894 (127.9.187.193:46179): tablet e5b52402337b4cb5988395e991f00762 (table test-table [id=835587a6110a4bbeb3b0167cba3cce70]) successfully deleted
Aug 08 17:40:55 dist-test-slave-bqcl krb5kdc[11712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210855, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.187.193@KRBTEST.COM
I20260808 17:40:55.764855 12577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.753143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47946 (local address 127.9.187.193:46179)
0808 17:40:55.753178 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.753180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.754311 (+ 1131us) server_negotiation.cc:407] Connection header received
0808 17:40:55.754407 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.754409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.754420 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.754452 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:55.755229 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.755936 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.757019 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.757308 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.757349 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.760942 (+ 3593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:55.760953 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:55.760953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:55.760961 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:55.763511 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.763973 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.763977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.763977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.764063 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.764267 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.764268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.764268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.764441 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:55.764581 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.764672 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.764757 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 17:40:55.765139 12116 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47946
I20260808 17:40:55.774196 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:55.766282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59864 (local address 127.9.187.254:40055)
0808 17:40:55.766329 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:55.766331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:55.766370 (+ 39us) server_negotiation.cc:407] Connection header received
0808 17:40:55.766441 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:55.766442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:55.766454 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:55.766512 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:55.767094 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.767828 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.768849 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:55.769180 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:55.769248 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:55.770851 (+ 1603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:55.770853 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:55.770853 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:55.770861 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:55.772552 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.773127 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.773129 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.773129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.773203 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:55.773421 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:55.773422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:55.773422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:55.773648 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:55.773740 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:55.773963 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 17:40:55.774046 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 17:40:55.774817 11786 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59864
I20260808 17:40:55.775439 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 11909
I20260808 17:40:55.796434 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 12139
I20260808 17:40:55.806445 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 12338
I20260808 17:40:55.817742 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 11737
2026-08-08T17:40:55Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2547 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:40:55 dist-test-slave-bqcl krb5kdc[12684](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:40:55 dist-test-slave-bqcl krb5kdc[12684](info): set up 2 sockets
Aug 08 17:40:55 dist-test-slave-bqcl krb5kdc[12684](info): commencing operation
krb5kdc: starting...
W20260808 17:40:56.967079 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:40:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:40:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:40:57.089515 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33347
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:33347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:57.169539 12703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:57.169740 12703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:57.169760 12703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:57.170928 12703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:40:57.170971 12703 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 17:40:57.170984 12703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:57.171006 12703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:57.171030 12703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:40:57.171052 12703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:40:57.172525 12703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:33347
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:57.172753 12703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:57.172959 12703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:57.177492 12711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:57.177511 12710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:57.177563 12713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:57.177832 12703 server_base.cc:1034] running on GCE node
I20260808 17:40:57.178059 12703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:57.178352 12703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:57.179495 12703 hybrid_clock.cc:648] HybridClock initialized: now 1786210857179477 us; error 28 us; skew 500 ppm
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:57.181874 12703 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:40:57.182304 12703 webserver.cc:460] Webserver started at http://127.9.187.254:36129/ using document root <none> and password file <none>
I20260808 17:40:57.182480 12703 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:57.182519 12703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:57.182608 12703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:57.183598 12703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "3e0c64b0d6c2434f83369393100f7092"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "fbbcd0acd0f99fcf25886a15b8af13b8"
server_key_iv: "b9e9eea29742a492ddc59432833ad03e"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.183892 12703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "3e0c64b0d6c2434f83369393100f7092"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "fbbcd0acd0f99fcf25886a15b8af13b8"
server_key_iv: "b9e9eea29742a492ddc59432833ad03e"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.185060 12703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:40:57.185746 12722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:57.185889 12703 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:40:57.185971 12703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "3e0c64b0d6c2434f83369393100f7092"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "fbbcd0acd0f99fcf25886a15b8af13b8"
server_key_iv: "b9e9eea29742a492ddc59432833ad03e"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.186024 12703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:57.206244 12703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:57.207834 12703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:57.207937 12703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:57.212245 12703 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:33347
I20260808 17:40:57.212337 12823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:33347 every 8 connection(s)
I20260808 17:40:57.212632 12703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:40:57.213285 12827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:57.213500 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 12703
I20260808 17:40:57.213579 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:40:57.213732 9967 external_mini_cluster.cc:1428] Setting key d196fa86fad3b5e50fa2403f92853992
I20260808 17:40:57.216136 12827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092: Bootstrap starting.
I20260808 17:40:57.216856 12827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:57.217170 12827 log.cc:824] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:57.217860 12827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092: No bootstrap required, opened a new log
I20260808 17:40:57.220083 12827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e0c64b0d6c2434f83369393100f7092" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33347 } }
I20260808 17:40:57.220259 12827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:57.220302 12827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e0c64b0d6c2434f83369393100f7092, State: Initialized, Role: FOLLOWER
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:57.220427 12827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e0c64b0d6c2434f83369393100f7092" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33347 } }
I20260808 17:40:57.220511 12827 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:40:57.220552 12827 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:40:57.220602 12827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:57.221220 12827 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e0c64b0d6c2434f83369393100f7092" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33347 } }
I20260808 17:40:57.221323 12827 leader_election.cc:302] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e0c64b0d6c2434f83369393100f7092; no voters:
I20260808 17:40:57.221485 12827 leader_election.cc:288] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:40:57.221521 12833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:57.221679 12833 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [term 1 LEADER]: Becoming Leader. State: Replica: 3e0c64b0d6c2434f83369393100f7092, State: Running, Role: LEADER
I20260808 17:40:57.221778 12827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:40:57.221771 12833 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e0c64b0d6c2434f83369393100f7092" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33347 } }
I20260808 17:40:57.223008 12834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e0c64b0d6c2434f83369393100f7092" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e0c64b0d6c2434f83369393100f7092" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33347 } } }
I20260808 17:40:57.223098 12834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [sys.catalog]: This master's current role is: LEADER
I20260808 17:40:57.223305 12835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e0c64b0d6c2434f83369393100f7092. Latest consensus state: current_term: 1 leader_uuid: "3e0c64b0d6c2434f83369393100f7092" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e0c64b0d6c2434f83369393100f7092" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33347 } } }
W20260808 17:40:57.223433 12858 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 17:40:57.223632 12835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092 [sys.catalog]: This master's current role is: LEADER
W20260808 17:40:57.223641 12858 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:40:57.223708 12860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:40:57.223869 12860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:40:57.224737 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.214219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36006 (local address 127.9.187.254:33347)
0808 17:40:57.214425 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.214435 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.214471 (+ 36us) server_negotiation.cc:407] Connection header received
0808 17:40:57.214970 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.214979 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.215042 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.215192 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:57.215779 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.217070 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.217814 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.218428 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.218532 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.220902 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:57.220906 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:57.220907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:57.220919 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:57.222760 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.223322 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.223325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.223325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.223431 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.223666 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.223667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.223668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.223967 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:57.224118 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.224458 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.224592 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":90,"threads_started":1}
I20260808 17:40:57.225432 12860 catalog_manager.cc:1347] Generated new cluster ID: 5909d2ca98d04bf19af63aa8c9378a67
I20260808 17:40:57.225484 12860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:40:57.236166 12860 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:40:57.236768 12860 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:40:57.251372 12860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092: Generated new TSK 0
I20260808 17:40:57.251586 12860 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:40:57.276481 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33347
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:57.356454 12869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:57.356652 12869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:57.356674 12869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:57.357774 12869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:57.357815 12869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:57.357834 12869 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 17:40:57.357857 12869 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:40:57.357885 12869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:40:57.359314 12869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.187.254:33347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:57.359514 12869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:57.359716 12869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:57.364499 12878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:57.364482 12882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:57.364486 12874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:57.364666 12869 server_base.cc:1034] running on GCE node
I20260808 17:40:57.364904 12869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:57.365119 12869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:57.366257 12869 hybrid_clock.cc:648] HybridClock initialized: now 1786210857366245 us; error 27 us; skew 500 ppm
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:57.368587 12869 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:40:57.368965 12869 webserver.cc:460] Webserver started at http://127.9.187.193:38265/ using document root <none> and password file <none>
I20260808 17:40:57.369134 12869 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:57.369171 12869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:57.369262 12869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:57.370262 12869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "e1980b27d22543ca99f6f4f38604ac79"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "b5d02bbb2c82985fbb34663690a1bab6"
server_key_iv: "d771d5a46b7f077e218506f966770c18"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.370563 12869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "e1980b27d22543ca99f6f4f38604ac79"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "b5d02bbb2c82985fbb34663690a1bab6"
server_key_iv: "d771d5a46b7f077e218506f966770c18"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.371764 12869 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:57.372396 12893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:57.372541 12869 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:40:57.372624 12869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "e1980b27d22543ca99f6f4f38604ac79"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "b5d02bbb2c82985fbb34663690a1bab6"
server_key_iv: "d771d5a46b7f077e218506f966770c18"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.372695 12869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:57.396806 12869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:57.398567 12869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:57.398691 12869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:57.399176 12869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:57.399220 12869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:57.399241 12869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:57.399252 12869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:57.405319 12869 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:42643
I20260808 17:40:57.405375 13088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:42643 every 8 connection(s)
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:57.405764 12869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:40:57.408387 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.399625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:34197 (local address 127.9.187.254:33347)
0808 17:40:57.399694 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.399697 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.399849 (+ 152us) server_negotiation.cc:407] Connection header received
0808 17:40:57.400314 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.400315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.400328 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.400395 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:57.401205 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.401958 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.403434 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.403747 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.403822 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.406270 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:57.406272 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:57.406272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:57.406279 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:57.407330 (+ 1051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.407667 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.407667 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.407668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.407754 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.407922 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.407922 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.407923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.408016 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:57.408061 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.408263 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.408324 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 17:40:57.408514 12903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.399571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33347 (local address 127.9.187.193:34197)
0808 17:40:57.399723 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.399762 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.400223 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.400484 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.400488 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.400831 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:57.401099 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.401106 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.402078 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.402079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.403339 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.403341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.403837 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.403838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.403939 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.404401 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:57.404410 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:57.406165 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:57.407394 (+ 1229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.407400 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.407401 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.407609 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.407797 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.407798 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.407798 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.407881 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.408057 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:57.408060 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:57.408161 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.408237 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.408347 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260808 17:40:57.409006 13091 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33347
I20260808 17:40:57.409085 13091 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:57.409255 13091 heartbeater.cc:511] Master 127.9.187.254:33347 requested a full tablet report, sending...
I20260808 17:40:57.409777 12746 ts_manager.cc:194] Registered new tserver with Master: e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643)
I20260808 17:40:57.410665 12746 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:34197
I20260808 17:40:57.411486 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 12869
I20260808 17:40:57.411574 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:40:57.411748 9967 external_mini_cluster.cc:1428] Setting key 9ffa019106a8b275911e4c1cba8b909c
I20260808 17:40:57.415174 13104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.409924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33347 (local address 127.9.187.193:33613)
0808 17:40:57.410074 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.410086 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.410180 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.410286 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.410286 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.410477 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:57.410533 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.410534 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.411163 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.411164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.411936 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.411939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.412304 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.412304 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.412375 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.412763 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:57.412767 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:57.413014 (+ 247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:57.414372 (+ 1358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.414373 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.414374 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.414531 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.414706 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.414706 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.414707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.414752 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.414957 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:57.414957 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:57.414989 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.415045 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.415113 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":26,"thread_start_us":63,"threads_started":1}
I20260808 17:40:57.415226 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.409972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:33613 (local address 127.9.187.254:33347)
0808 17:40:57.410010 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.410012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.410156 (+ 144us) server_negotiation.cc:407] Connection header received
0808 17:40:57.410237 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.410237 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.410245 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.410278 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:57.410593 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.411090 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.412036 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.412244 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.412298 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.413092 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:57.413094 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:57.413094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:57.413100 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:57.414285 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.414591 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.414592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.414593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.414652 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.414797 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.414797 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.414798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.414909 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:57.414968 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.415073 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.415146 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:40:57.436300 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33347
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:57.515705 13110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:57.515902 13110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:57.515924 13110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:57.517030 13110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:57.517072 13110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:57.517091 13110 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 17:40:57.517103 13110 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:40:57.517118 13110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:40:57.518556 13110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.187.254:33347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:57.518781 13110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:57.518987 13110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:57.523927 13124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:57.523945 13119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:57.523945 13121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:57.524250 13110 server_base.cc:1034] running on GCE node
I20260808 17:40:57.524402 13110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:57.524622 13110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:57.525771 13110 hybrid_clock.cc:648] HybridClock initialized: now 1786210857525754 us; error 30 us; skew 500 ppm
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:57.528214 13110 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:40:57.528653 13110 webserver.cc:460] Webserver started at http://127.9.187.194:37423/ using document root <none> and password file <none>
I20260808 17:40:57.528872 13110 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:57.528915 13110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:57.529033 13110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:57.530021 13110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "e0e616806ea2444c832260a0ca77071d"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "493cabda281586e0478dbb878c0010e8"
server_key_iv: "b2ea8d336e1209adae866d3a4e96aea7"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.530422 13110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "e0e616806ea2444c832260a0ca77071d"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "493cabda281586e0478dbb878c0010e8"
server_key_iv: "b2ea8d336e1209adae866d3a4e96aea7"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.531646 13110 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:57.532284 13146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:57.532420 13110 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:40:57.532509 13110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "e0e616806ea2444c832260a0ca77071d"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "493cabda281586e0478dbb878c0010e8"
server_key_iv: "b2ea8d336e1209adae866d3a4e96aea7"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.532599 13110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:57.542295 13110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:57.544299 13110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:57.544427 13110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:57.544879 13110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:57.544920 13110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:57.544948 13110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:57.544966 13110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:57.551664 13110 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:42397
I20260808 17:40:57.551745 13332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:42397 every 8 connection(s)
I20260808 17:40:57.552006 13110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:40:57.554108 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.545343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:54595 (local address 127.9.187.254:33347)
0808 17:40:57.545391 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.545393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.545614 (+ 221us) server_negotiation.cc:407] Connection header received
0808 17:40:57.546093 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.546095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.546109 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.546183 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:57.546817 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.547565 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.549054 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.549359 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.549433 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.551744 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:57.551746 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:57.551746 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:57.551755 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:57.553098 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.553432 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.553433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.553433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.553481 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.553654 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.553654 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.553654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.553745 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:57.553790 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.553984 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.554044 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:40:57.554312 13160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.545340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33347 (local address 127.9.187.194:54595)
0808 17:40:57.545505 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.545540 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.545999 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.546262 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.546266 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.546548 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:57.546723 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.546728 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.547672 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.547674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.548958 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.548961 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.549458 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.549459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.549606 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.550020 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:57.550030 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:57.551633 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:57.553166 (+ 1533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.553169 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.553171 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.553371 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.553529 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.553529 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.553530 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.553614 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.553790 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:57.553792 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:57.553891 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.553968 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.554087 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
I20260808 17:40:57.554731 13334 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33347
I20260808 17:40:57.554813 13334 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:57.554981 13334 heartbeater.cc:511] Master 127.9.187.254:33347 requested a full tablet report, sending...
I20260808 17:40:57.555348 12746 ts_manager.cc:194] Registered new tserver with Master: e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397)
I20260808 17:40:57.555751 12746 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:54595
I20260808 17:40:57.560340 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.555748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:56465 (local address 127.9.187.254:33347)
0808 17:40:57.555787 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.555788 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.555849 (+ 61us) server_negotiation.cc:407] Connection header received
0808 17:40:57.555935 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.555936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.555946 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.555987 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:57.556296 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.556744 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.557386 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.557584 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.557635 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.558388 (+ 753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:57.558390 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:57.558390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:57.558397 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:57.559338 (+ 941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.559632 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.559633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.559633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.559688 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.559848 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.559849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.559850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.559987 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:57.560045 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.560188 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.560254 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:40:57.560346 13347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.555665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33347 (local address 127.9.187.194:56465)
0808 17:40:57.555782 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.555793 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.555875 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.555992 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.555993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.556171 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:57.556221 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.556223 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.556828 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.556829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.557319 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.557320 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.557640 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.557641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.557709 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.558020 (+ 311us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:57.558024 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:57.558315 (+ 291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:57.559408 (+ 1093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.559409 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.559409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.559572 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.559740 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.559741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.559741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.559798 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.560052 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:57.560053 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:57.560099 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.560160 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.560255 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":61,"threads_started":1}
I20260808 17:40:57.560755 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 13110
I20260808 17:40:57.560830 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:40:57.561007 9967 external_mini_cluster.cc:1428] Setting key 631681f0023facca6da791ada62a3ac2
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:40:57.584378 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33347
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:40:57.664641 13355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:40:57.664850 13355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:40:57.664876 13355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:40:57.665964 13355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:40:57.666013 13355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:40:57.666034 13355 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 17:40:57.666046 13355 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:40:57.666064 13355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:40:57.667495 13355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.187.254:33347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:40:57.667689 13355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:40:57.667873 13355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:40:57.672744 13363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:57.672766 13368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:40:57.672919 13361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:40:57.672981 13355 server_base.cc:1034] running on GCE node
I20260808 17:40:57.673224 13355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:40:57.673465 13355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:40:57.674620 13355 hybrid_clock.cc:648] HybridClock initialized: now 1786210857674603 us; error 28 us; skew 500 ppm
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:40:57.677205 13355 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:40:57.677620 13355 webserver.cc:460] Webserver started at http://127.9.187.195:44127/ using document root <none> and password file <none>
I20260808 17:40:57.677793 13355 fs_manager.cc:359] Metadata directory not provided
I20260808 17:40:57.677830 13355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:40:57.677919 13355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:40:57.678925 13355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "624f2d53e0b548998a5fbb99f5305d38"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "04853fbde16038c160df3de8eea23fe9"
server_key_iv: "53e787b9a994da75a6c60b06ab7a9a26"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.679229 13355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "624f2d53e0b548998a5fbb99f5305d38"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "04853fbde16038c160df3de8eea23fe9"
server_key_iv: "53e787b9a994da75a6c60b06ab7a9a26"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.680476 13355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:40:57.681152 13376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:57.681325 13355 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:40:57.681411 13355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "624f2d53e0b548998a5fbb99f5305d38"
format_stamp: "Formatted at 2026-08-08 17:40:57 on dist-test-slave-bqcl"
server_key: "04853fbde16038c160df3de8eea23fe9"
server_key_iv: "53e787b9a994da75a6c60b06ab7a9a26"
server_key_version: "encryptionkey@0"
I20260808 17:40:57.681463 13355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:40:57.691817 13355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:40:57.693792 13355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:40:57.693899 13355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:40:57.694386 13355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:40:57.694430 13355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:57.694451 13355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:40:57.694463 13355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:57.700541 13355 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:43937
I20260808 17:40:57.700652 13553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:43937 every 8 connection(s)
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:57.700945 13355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:40:57.703411 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.694812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:35023 (local address 127.9.187.254:33347)
0808 17:40:57.694873 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.694876 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.695050 (+ 174us) server_negotiation.cc:407] Connection header received
0808 17:40:57.695498 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.695499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.695511 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.695591 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:57.696357 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.697100 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.698579 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.698874 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.698948 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.701277 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:57.701279 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:57.701279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:57.701287 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:57.702401 (+ 1114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.702754 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.702754 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.702754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.702802 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.702973 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.702973 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.702973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.703062 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:57.703106 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.703292 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.703348 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:40:57.703545 13394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.694780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33347 (local address 127.9.187.195:35023)
0808 17:40:57.694927 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.694967 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.695414 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.695666 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.695670 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.695983 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:57.696256 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.696262 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.697219 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.697220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.698493 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.698496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.698958 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.698959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.699082 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.699542 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:57.699553 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:57.701159 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:57.702476 (+ 1317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.702482 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.702483 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.702697 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.702845 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.702846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.702846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.702932 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.703101 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:57.703103 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:57.703204 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.703277 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.703385 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":80,"threads_started":1}
I20260808 17:40:57.704078 13555 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33347
I20260808 17:40:57.704221 13555 heartbeater.cc:464] Registering TS with master...
I20260808 17:40:57.704464 13555 heartbeater.cc:511] Master 127.9.187.254:33347 requested a full tablet report, sending...
I20260808 17:40:57.704886 12748 ts_manager.cc:194] Registered new tserver with Master: 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195:43937)
I20260808 17:40:57.705395 12748 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:35023
I20260808 17:40:57.708667 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 13355
I20260808 17:40:57.708745 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:40:57.708927 9967 external_mini_cluster.cc:1428] Setting key 2eaf1597cb4a12eb4af517c2c48815c3
I20260808 17:40:57.710053 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:40:57.719645 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.706548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:34243 (local address 127.9.187.254:33347)
0808 17:40:57.710904 (+ 4356us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.710906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.714316 (+ 3410us) server_negotiation.cc:407] Connection header received
0808 17:40:57.714371 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.714372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.714383 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.714429 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:57.714731 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.715207 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.715923 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.716130 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.716184 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.717274 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:57.717276 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:57.717276 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:57.717284 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:57.718683 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.718976 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.718978 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.718978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.719035 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.719197 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.719198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.719198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.719294 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:57.719347 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.719482 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.719550 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4335}
I20260808 17:40:57.719650 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.706452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33347 (local address 127.9.187.195:34243)
0808 17:40:57.714242 (+ 7790us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.714254 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.714316 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.714432 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.714433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.714615 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:57.714666 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.714667 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.715294 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.715295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.715849 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.715851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.716190 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.716191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.716265 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.716813 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:57.716818 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:57.717176 (+ 358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:57.718758 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.718759 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.718759 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.718919 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.719088 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.719089 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.719090 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.719147 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.719349 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:57.719350 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:57.719395 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.719454 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.719557 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7763,"thread_start_us":86,"threads_started":1}
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:57.736855 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.729762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36016 (local address 127.9.187.254:33347)
0808 17:40:57.729826 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.729828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.729839 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:40:57.729880 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.729881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.729892 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.729952 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:57.730468 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.731225 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.731898 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.732183 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.732273 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.734223 (+ 1950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:57.734224 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:57.734225 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:57.734238 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:57.735814 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.736171 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.736172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.736172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.736245 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.736397 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.736398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.736398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.736521 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:57.736617 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.736684 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.736758 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 17:40:57.738682 12748 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36016:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:40:57.740890 12748 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:40:57.747800 13577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.743387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51598 (local address 127.9.187.193:42643)
0808 17:40:57.743677 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.743682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.743693 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:40:57.743735 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.743737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.743754 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.743844 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:57.744057 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.744876 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.746485 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.747262 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.747315 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.747369 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.747642 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.747688 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":81,"threads_started":1}
I20260808 17:40:57.748090 13575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.743197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:42643 (local address 127.0.0.1:51598)
0808 17:40:57.743355 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.743394 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.743457 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.743903 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.743907 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.743910 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:57.743983 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.743985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.744958 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.744960 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.746362 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.746365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.747434 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.747435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.747514 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.747526 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.747936 (+ 410us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.748018 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":59,"threads_started":1}
I20260808 17:40:57.748693 13574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.743411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:42397 (local address 127.0.0.1:43122)
0808 17:40:57.743906 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.743915 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.743968 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.744241 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.744242 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.744244 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:57.744297 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.744299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.745600 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.745602 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.747120 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.747124 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.748172 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.748173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.748526 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.748531 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.748578 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.748620 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":53,"threads_started":1}
I20260808 17:40:57.748937 13584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.743590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43122 (local address 127.9.187.194:42397)
0808 17:40:57.743773 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.743778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.744038 (+ 260us) server_negotiation.cc:407] Connection header received
0808 17:40:57.744083 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.744085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.744102 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.744175 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:57.744368 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.745494 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.747226 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.748013 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.748082 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.748136 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.748808 (+ 672us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.748856 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":109,"threads_started":1}
I20260808 17:40:57.748844 12988 tablet_service.cc:1467] Processing CreateTablet for tablet 06bc89c5460a43a5b3fd07e8989c344b (DEFAULT_TABLE table=test-table [id=606c12c5a75943d89ce5e63921c64e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:57.749274 12988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06bc89c5460a43a5b3fd07e8989c344b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:57.749437 13576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.743197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:43937 (local address 127.0.0.1:40564)
0808 17:40:57.743778 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.743789 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.743833 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.745123 (+ 1290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.745124 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.745127 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:57.745229 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.745230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.746560 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.746561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.747606 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.747608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.749176 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.749177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.749261 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.749265 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.749327 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.749365 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"mutex_wait_us":41,"thread_start_us":50,"threads_started":1}
I20260808 17:40:57.749735 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.743550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40564 (local address 127.9.187.195:43937)
0808 17:40:57.743977 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.743981 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.743991 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:40:57.744977 (+ 986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.744980 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.745003 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.745152 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:57.745363 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.746454 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.747704 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.748947 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.749169 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.749231 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.749422 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.749461 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":78,"threads_started":1}
I20260808 17:40:57.750569 13462 tablet_service.cc:1467] Processing CreateTablet for tablet 06bc89c5460a43a5b3fd07e8989c344b (DEFAULT_TABLE table=test-table [id=606c12c5a75943d89ce5e63921c64e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:57.750960 13462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06bc89c5460a43a5b3fd07e8989c344b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:57.750833 13224 tablet_service.cc:1467] Processing CreateTablet for tablet 06bc89c5460a43a5b3fd07e8989c344b (DEFAULT_TABLE table=test-table [id=606c12c5a75943d89ce5e63921c64e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:57.751183 13224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06bc89c5460a43a5b3fd07e8989c344b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:57.753500 13585 tablet_bootstrap.cc:492] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: Bootstrap starting.
I20260808 17:40:57.754256 13585 tablet_bootstrap.cc:654] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:57.754601 13585 log.cc:824] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:57.755043 13586 tablet_bootstrap.cc:492] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: Bootstrap starting.
I20260808 17:40:57.755471 13585 tablet_bootstrap.cc:492] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: No bootstrap required, opened a new log
I20260808 17:40:57.755555 13585 ts_tablet_manager.cc:1397] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 17:40:57.756086 13586 tablet_bootstrap.cc:654] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:57.756429 13586 log.cc:824] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:57.757273 13586 tablet_bootstrap.cc:492] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: No bootstrap required, opened a new log
I20260808 17:40:57.757354 13586 ts_tablet_manager.cc:1397] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:40:57.757548 13585 raft_consensus.cc:348] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } }
I20260808 17:40:57.757730 13585 raft_consensus.cc:374] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:57.757776 13585 raft_consensus.cc:729] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1980b27d22543ca99f6f4f38604ac79, State: Initialized, Role: FOLLOWER
I20260808 17:40:57.757899 13585 consensus_queue.cc:260] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } }
I20260808 17:40:57.758226 13585 ts_tablet_manager.cc:1428] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 17:40:57.758284 13091 heartbeater.cc:503] Master 127.9.187.254:33347 was elected leader, sending a full tablet report...
I20260808 17:40:57.758472 13589 tablet_bootstrap.cc:492] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: Bootstrap starting.
I20260808 17:40:57.759238 13589 tablet_bootstrap.cc:654] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:57.759567 13589 log.cc:824] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: Log is configured to *not* fsync() on all Append() calls
I20260808 17:40:57.759793 13586 raft_consensus.cc:348] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } }
I20260808 17:40:57.759933 13586 raft_consensus.cc:374] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:57.759963 13586 raft_consensus.cc:729] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624f2d53e0b548998a5fbb99f5305d38, State: Initialized, Role: FOLLOWER
I20260808 17:40:57.760053 13586 consensus_queue.cc:260] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } }
I20260808 17:40:57.760322 13586 ts_tablet_manager.cc:1428] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:40:57.760357 13555 heartbeater.cc:503] Master 127.9.187.254:33347 was elected leader, sending a full tablet report...
I20260808 17:40:57.760476 13589 tablet_bootstrap.cc:492] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: No bootstrap required, opened a new log
I20260808 17:40:57.760545 13589 ts_tablet_manager.cc:1397] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:40:57.762108 13589 raft_consensus.cc:348] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } }
I20260808 17:40:57.762298 13589 raft_consensus.cc:374] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:57.762341 13589 raft_consensus.cc:729] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0e616806ea2444c832260a0ca77071d, State: Initialized, Role: FOLLOWER
I20260808 17:40:57.762465 13589 consensus_queue.cc:260] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } }
I20260808 17:40:57.762763 13589 ts_tablet_manager.cc:1428] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 17:40:57.762804 13334 heartbeater.cc:503] Master 127.9.187.254:33347 was elected leader, sending a full tablet report...
W20260808 17:40:57.802537 13337 tablet.cc:2369] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:40:57.865625 13594 raft_consensus.cc:482] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:40:57.865747 13594 raft_consensus.cc:504] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } }
I20260808 17:40:57.866050 13594 leader_election.cc:288] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643), e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397)
I20260808 17:40:57.868876 13577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.866359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:50729 (local address 127.9.187.193:42643)
0808 17:40:57.866408 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.866411 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.866421 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:40:57.866482 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.866483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.866492 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.866560 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:57.866751 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.867277 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.868203 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.868555 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.868616 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.868626 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.868767 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.868804 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:40:57.868894 13584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.866370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:48413 (local address 127.9.187.194:42397)
0808 17:40:57.866409 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.866411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.866557 (+ 146us) server_negotiation.cc:407] Connection header received
0808 17:40:57.866629 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.866630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.866639 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.866696 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:57.866848 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.867299 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.868200 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.868562 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.868623 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.868632 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.868796 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.868835 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:40:57.868892 13394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.866289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:42643 (local address 127.9.187.195:50729)
0808 17:40:57.866357 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.866369 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.866414 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.866595 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.866596 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.866598 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:57.866680 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.866683 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.867349 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.867350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.868108 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.868111 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.868628 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.868629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.868703 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.868706 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.868745 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.868779 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":1}
I20260808 17:40:57.868909 13597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.866291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:42397 (local address 127.9.187.195:48413)
0808 17:40:57.866489 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.866500 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.866559 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.866704 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.866704 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.866705 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:57.866788 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.866789 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.867377 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.867377 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.868109 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.868111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.868641 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.868642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.868719 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.868722 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.868781 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.868818 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":20,"thread_start_us":117,"threads_started":1}
I20260808 17:40:57.869295 13023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06bc89c5460a43a5b3fd07e8989c344b" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1980b27d22543ca99f6f4f38604ac79" is_pre_election: true
I20260808 17:40:57.869450 13023 raft_consensus.cc:2454] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 0.
I20260808 17:40:57.869473 13253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06bc89c5460a43a5b3fd07e8989c344b" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e616806ea2444c832260a0ca77071d" is_pre_election: true
I20260808 17:40:57.869632 13253 raft_consensus.cc:2454] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 0.
I20260808 17:40:57.869725 13384 leader_election.cc:302] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624f2d53e0b548998a5fbb99f5305d38, e1980b27d22543ca99f6f4f38604ac79; no voters:
I20260808 17:40:57.869884 13594 raft_consensus.cc:2781] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:40:57.869947 13594 raft_consensus.cc:482] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:40:57.869972 13594 raft_consensus.cc:3037] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:57.870697 13594 raft_consensus.cc:504] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } }
I20260808 17:40:57.870820 13594 leader_election.cc:288] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 election: Requested vote from peers e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643), e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397)
I20260808 17:40:57.870975 13023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06bc89c5460a43a5b3fd07e8989c344b" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1980b27d22543ca99f6f4f38604ac79"
I20260808 17:40:57.871011 13253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06bc89c5460a43a5b3fd07e8989c344b" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e616806ea2444c832260a0ca77071d"
I20260808 17:40:57.871047 13023 raft_consensus.cc:3037] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:57.871091 13253 raft_consensus.cc:3037] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:57.871770 13023 raft_consensus.cc:2454] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 1.
I20260808 17:40:57.871937 13384 leader_election.cc:302] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624f2d53e0b548998a5fbb99f5305d38, e1980b27d22543ca99f6f4f38604ac79; no voters:
I20260808 17:40:57.872020 13594 raft_consensus.cc:2781] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:57.872107 13253 raft_consensus.cc:2454] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 1.
I20260808 17:40:57.872207 13594 raft_consensus.cc:686] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 1 LEADER]: Becoming Leader. State: Replica: 624f2d53e0b548998a5fbb99f5305d38, State: Running, Role: LEADER
I20260808 17:40:57.872310 13594 consensus_queue.cc:237] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } }
I20260808 17:40:57.873162 12748 catalog_manager.cc:5495] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195). New cstate: current_term: 1 leader_uuid: "624f2d53e0b548998a5fbb99f5305d38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } health_report { overall_health: UNKNOWN } } }
W20260808 17:40:57.906427 13092 tablet.cc:2369] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 17:40:57 dist-test-slave-bqcl krb5kdc[12684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210857, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:57.912982 13608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.906717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33347 (local address 127.0.0.1:36024)
0808 17:40:57.906871 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:57.906880 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:57.906943 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:57.907076 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:57.907077 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:57.907367 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:40:57.907410 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.907412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.908028 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.908029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.908588 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:57.908590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.908955 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.908956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:57.909009 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.909449 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:40:57.909454 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:40:57.910812 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:40:57.912012 (+ 1200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.912019 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.912021 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.912202 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.912369 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:40:57.912370 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:40:57.912370 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:40:57.912421 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:40:57.912626 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:40:57.912633 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:40:57.912681 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 17:40:57.912737 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:40:57.912867 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":2,"thread_start_us":87,"threads_started":1}
I20260808 17:40:57.913030 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:57.906774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36024 (local address 127.9.187.254:33347)
0808 17:40:57.906837 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:57.906839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:57.906934 (+ 95us) server_negotiation.cc:407] Connection header received
0808 17:40:57.906998 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:57.906998 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:57.907007 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:57.907071 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:57.907485 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.907960 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.908656 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:57.908892 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:57.908947 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:57.910891 (+ 1944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:57.910892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:57.910892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:57.910899 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:57.911944 (+ 1045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.912265 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.912266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.912267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.912319 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:57.912469 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:57.912470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:57.912470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:57.912575 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:57.912629 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:57.912765 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 17:40:57.912925 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":93,"server-negotiator.queue_time_us":36}
I20260808 17:40:57.914868 12748 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:36024:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 17:40:57.915056 12748 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:40:57.916424 12988 tablet_service.cc:1467] Processing CreateTablet for tablet e5f72fa8ccbd4c169078f85c9cf9a214 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ee301533161945eba2c3ca5eec6096ae]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:40:57.916450 13224 tablet_service.cc:1467] Processing CreateTablet for tablet e5f72fa8ccbd4c169078f85c9cf9a214 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ee301533161945eba2c3ca5eec6096ae]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:40:57.916599 13224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5f72fa8ccbd4c169078f85c9cf9a214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:57.916599 12988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5f72fa8ccbd4c169078f85c9cf9a214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:57.916712 13462 tablet_service.cc:1467] Processing CreateTablet for tablet e5f72fa8ccbd4c169078f85c9cf9a214 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ee301533161945eba2c3ca5eec6096ae]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:40:57.916858 13462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5f72fa8ccbd4c169078f85c9cf9a214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:57.917804 13589 tablet_bootstrap.cc:492] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d: Bootstrap starting.
I20260808 17:40:57.918107 13585 tablet_bootstrap.cc:492] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: Bootstrap starting.
I20260808 17:40:57.918219 13589 tablet_bootstrap.cc:654] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:57.918599 13585 tablet_bootstrap.cc:654] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:57.918860 13589 tablet_bootstrap.cc:492] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d: No bootstrap required, opened a new log
I20260808 17:40:57.918888 13586 tablet_bootstrap.cc:492] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38: Bootstrap starting.
I20260808 17:40:57.918917 13589 ts_tablet_manager.cc:1397] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 17:40:57.919065 13589 raft_consensus.cc:348] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:57.919142 13589 raft_consensus.cc:374] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:57.919159 13589 raft_consensus.cc:729] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0e616806ea2444c832260a0ca77071d, State: Initialized, Role: FOLLOWER
I20260808 17:40:57.919200 13589 consensus_queue.cc:260] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:57.919229 13585 tablet_bootstrap.cc:492] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: No bootstrap required, opened a new log
I20260808 17:40:57.919270 13585 ts_tablet_manager.cc:1397] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:57.919301 13586 tablet_bootstrap.cc:654] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:57.919308 13589 ts_tablet_manager.cc:1428] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 17:40:57.919445 13595 tablet_replica.cc:439] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } }
I20260808 17:40:57.919435 13585 raft_consensus.cc:348] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:57.919504 13585 raft_consensus.cc:374] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:57.919507 13595 tablet_replica.cc:442] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:57.919525 13585 raft_consensus.cc:729] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1980b27d22543ca99f6f4f38604ac79, State: Initialized, Role: FOLLOWER
I20260808 17:40:57.919566 13585 consensus_queue.cc:260] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:57.919679 13585 ts_tablet_manager.cc:1428] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:40:57.919808 13591 tablet_replica.cc:439] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } }
I20260808 17:40:57.919889 13591 tablet_replica.cc:442] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:57.919996 13586 tablet_bootstrap.cc:492] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38: No bootstrap required, opened a new log
I20260808 17:40:57.920042 13586 ts_tablet_manager.cc:1397] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:57.920189 13586 raft_consensus.cc:348] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:57.920248 13586 raft_consensus.cc:374] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:57.920261 13586 raft_consensus.cc:729] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624f2d53e0b548998a5fbb99f5305d38, State: Initialized, Role: FOLLOWER
I20260808 17:40:57.920297 13586 consensus_queue.cc:260] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:57.920384 13586 ts_tablet_manager.cc:1428] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:57.920538 13594 tablet_replica.cc:439] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } }
I20260808 17:40:57.920632 13594 tablet_replica.cc:442] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 17:40:57.951501 13556 tablet.cc:2369] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:40:58.077296 13591 raft_consensus.cc:482] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:40:58.077423 13591 raft_consensus.cc:504] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.077809 13591 leader_election.cc:288] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397), 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195:43937)
I20260808 17:40:58.081911 13584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:58.078194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:33641 (local address 127.9.187.194:42397)
0808 17:40:58.078237 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:58.078239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:58.078279 (+ 40us) server_negotiation.cc:407] Connection header received
0808 17:40:58.078312 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:58.078313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:58.078323 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:58.078394 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:58.078556 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.079227 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.080610 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.081155 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.081230 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:58.081240 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:58.081807 (+ 567us) server_negotiation.cc:299] Negotiation successful
0808 17:40:58.081847 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:40:58.081947 13618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:58.077982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:42397 (local address 127.9.187.193:33641)
0808 17:40:58.078180 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:58.078191 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:58.078253 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:58.078414 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:58.078415 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:58.078418 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:58.078480 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:58.078482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.079293 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.079294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:58.080513 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:58.080516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.081657 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.081660 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:58.081728 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:58.081733 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:40:58.081798 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 17:40:58.081852 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":88,"threads_started":1}
I20260808 17:40:58.082041 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:58.078045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:40559 (local address 127.9.187.195:43937)
0808 17:40:58.078111 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:58.078113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:58.078742 (+ 629us) server_negotiation.cc:407] Connection header received
0808 17:40:58.078910 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:58.078911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:58.078922 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:58.078953 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:40:58.079257 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.079978 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.081113 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.081660 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.081714 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:58.081723 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:58.081934 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 17:40:58.081980 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 17:40:58.082054 13617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:58.077985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:43937 (local address 127.9.187.193:40559)
0808 17:40:58.078639 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:58.078652 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:58.078803 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:58.079036 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:58.079038 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:58.079039 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:40:58.079119 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:58.079121 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.080091 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.080092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:58.080991 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:58.080995 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.081785 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.081786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:58.081858 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:58.081861 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:40:58.081917 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:40:58.081948 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":584,"threads_started":1}
I20260808 17:40:58.082491 13253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f72fa8ccbd4c169078f85c9cf9a214" candidate_uuid: "e1980b27d22543ca99f6f4f38604ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e616806ea2444c832260a0ca77071d" is_pre_election: true
I20260808 17:40:58.082588 13253 raft_consensus.cc:2454] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1980b27d22543ca99f6f4f38604ac79 in term 0.
I20260808 17:40:58.082710 13493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f72fa8ccbd4c169078f85c9cf9a214" candidate_uuid: "e1980b27d22543ca99f6f4f38604ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624f2d53e0b548998a5fbb99f5305d38" is_pre_election: true
I20260808 17:40:58.082762 12897 leader_election.cc:302] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0e616806ea2444c832260a0ca77071d, e1980b27d22543ca99f6f4f38604ac79; no voters:
I20260808 17:40:58.082864 13493 raft_consensus.cc:2454] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1980b27d22543ca99f6f4f38604ac79 in term 0.
I20260808 17:40:58.082914 13591 raft_consensus.cc:2781] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:40:58.082955 13591 raft_consensus.cc:482] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:40:58.082986 13591 raft_consensus.cc:3037] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:58.083731 13591 raft_consensus.cc:504] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.083853 13591 leader_election.cc:288] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [CANDIDATE]: Term 1 election: Requested vote from peers e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397), 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195:43937)
I20260808 17:40:58.083992 13253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f72fa8ccbd4c169078f85c9cf9a214" candidate_uuid: "e1980b27d22543ca99f6f4f38604ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e616806ea2444c832260a0ca77071d"
I20260808 17:40:58.084038 13493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f72fa8ccbd4c169078f85c9cf9a214" candidate_uuid: "e1980b27d22543ca99f6f4f38604ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624f2d53e0b548998a5fbb99f5305d38"
I20260808 17:40:58.084074 13253 raft_consensus.cc:3037] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:58.084106 13493 raft_consensus.cc:3037] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:58.084751 13253 raft_consensus.cc:2454] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1980b27d22543ca99f6f4f38604ac79 in term 1.
I20260808 17:40:58.084800 13493 raft_consensus.cc:2454] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1980b27d22543ca99f6f4f38604ac79 in term 1.
I20260808 17:40:58.084914 12897 leader_election.cc:302] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0e616806ea2444c832260a0ca77071d, e1980b27d22543ca99f6f4f38604ac79; no voters:
I20260808 17:40:58.085062 13591 raft_consensus.cc:2781] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:58.085184 13591 raft_consensus.cc:686] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [term 1 LEADER]: Becoming Leader. State: Replica: e1980b27d22543ca99f6f4f38604ac79, State: Running, Role: LEADER
I20260808 17:40:58.085297 13591 consensus_queue.cc:237] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.085707 13619 tablet_replica.cc:439] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: TxnStatusTablet state changed. Reason: New leader e1980b27d22543ca99f6f4f38604ac79. Latest consensus state: current_term: 1 leader_uuid: "e1980b27d22543ca99f6f4f38604ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } }
I20260808 17:40:58.085809 13619 tablet_replica.cc:442] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:40:58.085999 13622 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 17:40:58.086153 13622 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 17:40:58.086105 12748 catalog_manager.cc:5495] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193). New cstate: current_term: 1 leader_uuid: "e1980b27d22543ca99f6f4f38604ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } health_report { overall_health: UNKNOWN } } }
I20260808 17:40:58.101356 13577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:58.098844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51606 (local address 127.9.187.193:42643)
0808 17:40:58.098879 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:58.098881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:58.098946 (+ 65us) server_negotiation.cc:407] Connection header received
0808 17:40:58.099046 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:58.099047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:58.099061 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:58.099117 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:40:58.099258 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.099685 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.100695 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.100865 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.100910 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:58.101090 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:40:58.101175 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:40:58.101226 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:58.101290 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 17:40:58.101307 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:40:58.101420 13608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:58.098809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:42643 (local address 127.0.0.1:51606)
0808 17:40:58.098902 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:58.098912 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:58.098967 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:58.099142 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:58.099143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:58.099144 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:40:58.099197 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:58.099199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.099746 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.099747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:58.100621 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:58.100624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.100925 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.100926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:58.100990 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:58.101010 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:40:58.101227 (+ 217us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:40:58.101232 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:40:58.101289 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 17:40:58.101337 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 17:40:58.103169 13493 raft_consensus.cc:1261] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Refusing update from remote peer e1980b27d22543ca99f6f4f38604ac79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:58.103170 13253 raft_consensus.cc:1261] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Refusing update from remote peer e1980b27d22543ca99f6f4f38604ac79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:58.103464 13619 consensus_queue.cc:1035] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:58.103619 13591 consensus_queue.cc:1035] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:58.104825 13595 tablet_replica.cc:439] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d: TxnStatusTablet state changed. Reason: New leader e1980b27d22543ca99f6f4f38604ac79. Latest consensus state: current_term: 1 leader_uuid: "e1980b27d22543ca99f6f4f38604ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } }
I20260808 17:40:58.104930 13595 tablet_replica.cc:442] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:58.104880 13594 tablet_replica.cc:439] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38: TxnStatusTablet state changed. Reason: New leader e1980b27d22543ca99f6f4f38604ac79. Latest consensus state: current_term: 1 leader_uuid: "e1980b27d22543ca99f6f4f38604ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } }
I20260808 17:40:58.104961 13594 tablet_replica.cc:442] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:58.106321 13591 tablet_replica.cc:439] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e1980b27d22543ca99f6f4f38604ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } }
I20260808 17:40:58.106343 13619 tablet_replica.cc:439] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e1980b27d22543ca99f6f4f38604ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } }
I20260808 17:40:58.106406 13591 tablet_replica.cc:442] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:40:58.106422 13619 tablet_replica.cc:442] T e5f72fa8ccbd4c169078f85c9cf9a214 P e1980b27d22543ca99f6f4f38604ac79: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:40:58.106525 13628 mvcc.cc:205] Tried to move back new op lower bound from 7316319674788257792 to 7316319674717958144. Current Snapshot: MvccSnapshot[applied={T|T < 7316319674788257792}]
I20260808 17:40:58.106956 13594 tablet_replica.cc:439] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e1980b27d22543ca99f6f4f38604ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } }
I20260808 17:40:58.107030 13594 tablet_replica.cc:442] T e5f72fa8ccbd4c169078f85c9cf9a214 P 624f2d53e0b548998a5fbb99f5305d38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:58.107272 13595 tablet_replica.cc:439] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e1980b27d22543ca99f6f4f38604ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } } }
I20260808 17:40:58.107350 13595 tablet_replica.cc:442] T e5f72fa8ccbd4c169078f85c9cf9a214 P e0e616806ea2444c832260a0ca77071d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:40:58.107504 13633 mvcc.cc:205] Tried to move back new op lower bound from 7316319674788257792 to 7316319674717958144. Current Snapshot: MvccSnapshot[applied={T|T < 7316319674788257792 or (T in {7316319674788257792})}]
I20260808 17:40:58.114410 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:58.111903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40576 (local address 127.9.187.195:43937)
0808 17:40:58.111940 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:58.111942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:58.111964 (+ 22us) server_negotiation.cc:407] Connection header received
0808 17:40:58.112049 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:58.112050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:58.112064 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:58.112118 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:40:58.112263 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.112692 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.113720 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.113899 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.113941 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:58.114090 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:40:58.114223 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:40:58.114283 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:58.114346 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 17:40:58.114364 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:40:58.119135 13577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:58.116801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:40401 (local address 127.9.187.193:42643)
0808 17:40:58.116844 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:58.116845 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:58.116855 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:40:58.116874 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:58.116875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:58.116882 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:58.116927 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:40:58.117087 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.117527 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.118543 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.118718 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.118770 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:58.118961 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:40:58.118984 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:40:58.119015 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:58.119076 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 17:40:58.119090 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:40:58.119192 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:58.116718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:42643 (local address 127.9.187.195:40401)
0808 17:40:58.116780 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:58.116791 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:58.116836 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:58.116952 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:58.116952 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:58.116954 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:40:58.117012 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:58.117014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.117595 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.117596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:58.118456 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:58.118459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.118783 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.118783 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:58.118849 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:58.118865 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:40:58.119020 (+ 155us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:40:58.119022 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:40:58.119075 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 17:40:58.119117 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 17:40:58.121359 13253 raft_consensus.cc:1261] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Refusing update from remote peer 624f2d53e0b548998a5fbb99f5305d38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:58.121527 13023 raft_consensus.cc:1261] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Refusing update from remote peer 624f2d53e0b548998a5fbb99f5305d38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:58.121618 13598 consensus_queue.cc:1035] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:58.121749 13594 consensus_queue.cc:1035] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:58.123157 13632 mvcc.cc:205] Tried to move back new op lower bound from 7316319674863570944 to 7316319673845665792. Current Snapshot: MvccSnapshot[applied={T|T < 7316319674863570944}]
I20260808 17:40:58.130366 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:58.127626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:39149 (local address 127.9.187.195:43937)
0808 17:40:58.127662 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:58.127664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:58.127781 (+ 117us) server_negotiation.cc:407] Connection header received
0808 17:40:58.127837 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:58.127838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:58.127847 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:58.127898 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:40:58.128055 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.128529 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.129660 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.129916 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.129975 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:58.130176 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:40:58.130205 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:40:58.130247 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:58.130306 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 17:40:58.130321 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:40:58.130465 13651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:58.127493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:43937 (local address 127.9.187.193:39149)
0808 17:40:58.127673 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 17:40:58.127716 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 17:40:58.127782 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:40:58.127902 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:40:58.127903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:40:58.127905 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:40:58.127961 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:58.127962 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.128585 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.128586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:58.129586 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:40:58.129589 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:40:58.129984 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:40:58.129985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:40:58.130050 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:58.130067 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:40:58.130250 (+ 183us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:40:58.130251 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:40:58.130305 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 17:40:58.130346 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":101,"threads_started":1}
I20260808 17:40:58.140002 12748 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:40:58.140106 12748 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:40:58.140861 12748 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092: Sending DeleteTablet for 3 replicas of tablet 06bc89c5460a43a5b3fd07e8989c344b
I20260808 17:40:58.141242 12988 tablet_service.cc:1514] Processing DeleteTablet for tablet 06bc89c5460a43a5b3fd07e8989c344b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:58 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:51598
I20260808 17:40:58.141249 13224 tablet_service.cc:1514] Processing DeleteTablet for tablet 06bc89c5460a43a5b3fd07e8989c344b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:58 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:43122
I20260808 17:40:58.141734 13462 tablet_service.cc:1514] Processing DeleteTablet for tablet 06bc89c5460a43a5b3fd07e8989c344b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:58 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:40564
I20260808 17:40:58.141975 13663 tablet_replica.cc:330] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: stopping tablet replica
I20260808 17:40:58.142117 13663 raft_consensus.cc:2229] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:40:58.142071 12748 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36016:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:40:58.142256 12748 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:40:58.142447 13663 raft_consensus.cc:2258] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:58.142963 13663 ts_tablet_manager.cc:1905] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:58.143481 13224 tablet_service.cc:1467] Processing CreateTablet for tablet 02d0b317fac049cead752af7f2a52ba7 (DEFAULT_TABLE table=test-table [id=9f3bc6d123c94e1086f10b94ddb96270]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:58.143534 12988 tablet_service.cc:1467] Processing CreateTablet for tablet 02d0b317fac049cead752af7f2a52ba7 (DEFAULT_TABLE table=test-table [id=9f3bc6d123c94e1086f10b94ddb96270]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:58.143597 13224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d0b317fac049cead752af7f2a52ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:58.143654 12988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d0b317fac049cead752af7f2a52ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:58.144840 13589 tablet_bootstrap.cc:492] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d: Bootstrap starting.
I20260808 17:40:58.144970 13585 tablet_bootstrap.cc:492] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79: Bootstrap starting.
I20260808 17:40:58.145220 13589 tablet_bootstrap.cc:654] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:58.145375 13462 tablet_service.cc:1467] Processing CreateTablet for tablet 02d0b317fac049cead752af7f2a52ba7 (DEFAULT_TABLE table=test-table [id=9f3bc6d123c94e1086f10b94ddb96270]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:58.145426 13585 tablet_bootstrap.cc:654] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:58.145503 13462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d0b317fac049cead752af7f2a52ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:58.146755 13663 ts_tablet_manager.cc:1918] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:40:58.146885 13586 tablet_bootstrap.cc:492] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38: Bootstrap starting.
I20260808 17:40:58.147307 13586 tablet_bootstrap.cc:654] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:58.146881 13663 log.cc:1196] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/06bc89c5460a43a5b3fd07e8989c344b
I20260808 17:40:58.147679 13589 tablet_bootstrap.cc:492] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d: No bootstrap required, opened a new log
I20260808 17:40:58.147740 13589 ts_tablet_manager.cc:1397] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 17:40:58.147889 13589 raft_consensus.cc:348] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.147964 13589 raft_consensus.cc:374] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:58.147991 13589 raft_consensus.cc:729] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0e616806ea2444c832260a0ca77071d, State: Initialized, Role: FOLLOWER
I20260808 17:40:58.148034 13589 consensus_queue.cc:260] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.148131 13589 ts_tablet_manager.cc:1428] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 17:40:58.148254 13663 ts_tablet_manager.cc:1939] T 06bc89c5460a43a5b3fd07e8989c344b P 624f2d53e0b548998a5fbb99f5305d38: Deleting consensus metadata
I20260808 17:40:58.148669 12724 catalog_manager.cc:4841] TS 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195:43937): tablet 06bc89c5460a43a5b3fd07e8989c344b (table test-table [id=606c12c5a75943d89ce5e63921c64e76]) successfully deleted
I20260808 17:40:58.148815 13661 tablet_replica.cc:330] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: stopping tablet replica
I20260808 17:40:58.148923 13661 raft_consensus.cc:2229] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:40:58.148977 13661 raft_consensus.cc:2258] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:58.149364 13661 ts_tablet_manager.cc:1905] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:58.149483 13586 tablet_bootstrap.cc:492] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38: No bootstrap required, opened a new log
I20260808 17:40:58.149524 13586 ts_tablet_manager.cc:1397] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 17:40:58.149646 13586 raft_consensus.cc:348] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.149704 13586 raft_consensus.cc:374] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:58.149722 13586 raft_consensus.cc:729] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624f2d53e0b548998a5fbb99f5305d38, State: Initialized, Role: FOLLOWER
I20260808 17:40:58.149760 13586 consensus_queue.cc:260] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.149847 13586 ts_tablet_manager.cc:1428] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:58.149988 13662 tablet_replica.cc:330] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: stopping tablet replica
I20260808 17:40:58.150085 13662 raft_consensus.cc:2229] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:40:58.150156 13662 raft_consensus.cc:2258] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:58.150843 13662 ts_tablet_manager.cc:1905] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:58.150976 13661 ts_tablet_manager.cc:1918] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:40:58.151055 13661 log.cc:1196] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/wal/wals/06bc89c5460a43a5b3fd07e8989c344b
I20260808 17:40:58.151722 13661 ts_tablet_manager.cc:1939] T 06bc89c5460a43a5b3fd07e8989c344b P e1980b27d22543ca99f6f4f38604ac79: Deleting consensus metadata
I20260808 17:40:58.152127 12729 catalog_manager.cc:4841] TS e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643): tablet 06bc89c5460a43a5b3fd07e8989c344b (table test-table [id=606c12c5a75943d89ce5e63921c64e76]) successfully deleted
I20260808 17:40:58.152159 13662 ts_tablet_manager.cc:1918] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:40:58.152223 13662 log.cc:1196] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/06bc89c5460a43a5b3fd07e8989c344b
I20260808 17:40:58.152429 13662 ts_tablet_manager.cc:1939] T 06bc89c5460a43a5b3fd07e8989c344b P e0e616806ea2444c832260a0ca77071d: Deleting consensus metadata
I20260808 17:40:58.152793 12727 catalog_manager.cc:4841] TS e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397): tablet 06bc89c5460a43a5b3fd07e8989c344b (table test-table [id=606c12c5a75943d89ce5e63921c64e76]) successfully deleted
I20260808 17:40:58.154487 13585 tablet_bootstrap.cc:492] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79: No bootstrap required, opened a new log
I20260808 17:40:58.154559 13585 ts_tablet_manager.cc:1397] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260808 17:40:58.154687 13585 raft_consensus.cc:348] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.154762 13585 raft_consensus.cc:374] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:58.154789 13585 raft_consensus.cc:729] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1980b27d22543ca99f6f4f38604ac79, State: Initialized, Role: FOLLOWER
I20260808 17:40:58.154831 13585 consensus_queue.cc:260] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.154925 13585 ts_tablet_manager.cc:1428] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:58.204334 13598 raft_consensus.cc:482] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:40:58.204447 13598 raft_consensus.cc:504] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.204599 13598 leader_election.cc:288] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643), e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397)
I20260808 17:40:58.204861 13253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d0b317fac049cead752af7f2a52ba7" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e616806ea2444c832260a0ca77071d" is_pre_election: true
I20260808 17:40:58.204886 13023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d0b317fac049cead752af7f2a52ba7" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1980b27d22543ca99f6f4f38604ac79" is_pre_election: true
I20260808 17:40:58.204989 13023 raft_consensus.cc:2454] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 0.
I20260808 17:40:58.204988 13253 raft_consensus.cc:2454] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 0.
I20260808 17:40:58.205156 13384 leader_election.cc:302] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624f2d53e0b548998a5fbb99f5305d38, e1980b27d22543ca99f6f4f38604ac79; no voters:
I20260808 17:40:58.205282 13598 raft_consensus.cc:2781] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:40:58.205317 13598 raft_consensus.cc:482] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:40:58.205334 13598 raft_consensus.cc:3037] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:58.206211 13598 raft_consensus.cc:504] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.206362 13598 leader_election.cc:288] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 election: Requested vote from peers e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643), e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397)
I20260808 17:40:58.206547 13253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d0b317fac049cead752af7f2a52ba7" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e616806ea2444c832260a0ca77071d"
I20260808 17:40:58.206619 13253 raft_consensus.cc:3037] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:58.206621 13023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d0b317fac049cead752af7f2a52ba7" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1980b27d22543ca99f6f4f38604ac79"
I20260808 17:40:58.206696 13023 raft_consensus.cc:3037] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:58.207355 13253 raft_consensus.cc:2454] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 1.
I20260808 17:40:58.207500 13023 raft_consensus.cc:2454] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 1.
I20260808 17:40:58.207526 13382 leader_election.cc:302] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624f2d53e0b548998a5fbb99f5305d38, e0e616806ea2444c832260a0ca77071d; no voters:
I20260808 17:40:58.207605 13598 raft_consensus.cc:2781] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:58.207638 13598 raft_consensus.cc:686] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 LEADER]: Becoming Leader. State: Replica: 624f2d53e0b548998a5fbb99f5305d38, State: Running, Role: LEADER
I20260808 17:40:58.207677 13598 consensus_queue.cc:237] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:58.208230 12748 catalog_manager.cc:5495] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195). New cstate: current_term: 1 leader_uuid: "624f2d53e0b548998a5fbb99f5305d38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } health_report { overall_health: HEALTHY } } }
I20260808 17:40:58.226776 13253 raft_consensus.cc:1261] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Refusing update from remote peer 624f2d53e0b548998a5fbb99f5305d38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:58.227046 13598 consensus_queue.cc:1035] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:58.227293 13023 raft_consensus.cc:1261] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Refusing update from remote peer 624f2d53e0b548998a5fbb99f5305d38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:58.227615 13598 consensus_queue.cc:1035] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 17:40:58.232506 13633 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 17:40:59.751103 12748 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:40:59.751209 12748 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:40:59.752417 12748 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092: Sending DeleteTablet for 3 replicas of tablet 02d0b317fac049cead752af7f2a52ba7
I20260808 17:40:59.752655 12988 tablet_service.cc:1514] Processing DeleteTablet for tablet 02d0b317fac049cead752af7f2a52ba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:59 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:51598
I20260808 17:40:59.752681 13224 tablet_service.cc:1514] Processing DeleteTablet for tablet 02d0b317fac049cead752af7f2a52ba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:59 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:43122
I20260808 17:40:59.752694 13462 tablet_service.cc:1514] Processing DeleteTablet for tablet 02d0b317fac049cead752af7f2a52ba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:59 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:40564
I20260808 17:40:59.752987 13707 tablet_replica.cc:330] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79: stopping tablet replica
I20260808 17:40:59.753048 13708 tablet_replica.cc:330] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38: stopping tablet replica
I20260808 17:40:59.753106 13708 raft_consensus.cc:2229] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:40:59.753100 13707 raft_consensus.cc:2229] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:40:59.753146 13707 raft_consensus.cc:2258] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:59.753185 13708 raft_consensus.cc:2258] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:59.753391 13707 ts_tablet_manager.cc:1905] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:59.753391 13708 ts_tablet_manager.cc:1905] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:59.754307 13706 tablet_replica.cc:330] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d: stopping tablet replica
I20260808 17:40:59.754467 13706 raft_consensus.cc:2229] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:40:59.754555 13706 raft_consensus.cc:2258] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:59.754855 13706 ts_tablet_manager.cc:1905] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 17:40:59 dist-test-slave-bqcl krb5kdc[12684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210859, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
I20260808 17:40:59.832188 13707 ts_tablet_manager.cc:1918] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 17:40:59.832278 13707 log.cc:1196] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/wal/wals/02d0b317fac049cead752af7f2a52ba7
I20260808 17:40:59.832485 13707 ts_tablet_manager.cc:1939] T 02d0b317fac049cead752af7f2a52ba7 P e1980b27d22543ca99f6f4f38604ac79: Deleting consensus metadata
I20260808 17:40:59.834668 13706 ts_tablet_manager.cc:1918] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 17:40:59.834668 13708 ts_tablet_manager.cc:1918] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 17:40:59.834745 13706 log.cc:1196] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/02d0b317fac049cead752af7f2a52ba7
I20260808 17:40:59.834758 13708 log.cc:1196] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/02d0b317fac049cead752af7f2a52ba7
I20260808 17:40:59.834998 13708 ts_tablet_manager.cc:1939] T 02d0b317fac049cead752af7f2a52ba7 P 624f2d53e0b548998a5fbb99f5305d38: Deleting consensus metadata
I20260808 17:40:59.834998 13706 ts_tablet_manager.cc:1939] T 02d0b317fac049cead752af7f2a52ba7 P e0e616806ea2444c832260a0ca77071d: Deleting consensus metadata
Aug 08 17:40:59 dist-test-slave-bqcl krb5kdc[12684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210859, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:40:59.838851 13718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:59.831131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36026 (local address 127.9.187.254:33347)
0808 17:40:59.831523 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:59.831525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:59.831531 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:40:59.831555 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:59.831556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:59.831566 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:59.831618 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:40:59.832384 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:59.833128 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:59.833877 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:59.834088 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:59.834165 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:59.836641 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:40:59.836642 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:40:59.836642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:40:59.836649 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:40:59.837972 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:59.838278 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:59.838279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:59.838279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:59.838345 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:40:59.838472 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:40:59.838472 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:40:59.838472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:40:59.838568 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:40:59.838638 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:59.838704 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 17:40:59.838768 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":92,"threads_started":1}
I20260808 17:40:59.840253 12748 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:40:59.840425 12748 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:40:59.841727 12988 tablet_service.cc:1467] Processing CreateTablet for tablet 4d5d19e086a7402e9d15dd5f9bb77510 (DEFAULT_TABLE table=test-table [id=98afb61973bf4da1a3d691c20bb88456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:59.841763 13462 tablet_service.cc:1467] Processing CreateTablet for tablet 4d5d19e086a7402e9d15dd5f9bb77510 (DEFAULT_TABLE table=test-table [id=98afb61973bf4da1a3d691c20bb88456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:59.841761 13224 tablet_service.cc:1467] Processing CreateTablet for tablet 4d5d19e086a7402e9d15dd5f9bb77510 (DEFAULT_TABLE table=test-table [id=98afb61973bf4da1a3d691c20bb88456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:59.841867 13462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d5d19e086a7402e9d15dd5f9bb77510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:59.841868 12988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d5d19e086a7402e9d15dd5f9bb77510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:59.841879 13224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d5d19e086a7402e9d15dd5f9bb77510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:59.842933 13719 tablet_bootstrap.cc:492] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d: Bootstrap starting.
I20260808 17:40:59.843323 13724 tablet_bootstrap.cc:492] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79: Bootstrap starting.
I20260808 17:40:59.843626 13724 tablet_bootstrap.cc:654] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:59.843668 13719 tablet_bootstrap.cc:654] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:59.843931 13726 tablet_bootstrap.cc:492] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38: Bootstrap starting.
I20260808 17:40:59.844280 13726 tablet_bootstrap.cc:654] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:59.844638 13724 tablet_bootstrap.cc:492] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79: No bootstrap required, opened a new log
I20260808 17:40:59.844686 13724 ts_tablet_manager.cc:1397] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:59.844846 13726 tablet_bootstrap.cc:492] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38: No bootstrap required, opened a new log
I20260808 17:40:59.844836 13724 raft_consensus.cc:348] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:59.844897 13726 ts_tablet_manager.cc:1397] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:59.844903 13724 raft_consensus.cc:374] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:59.844928 13724 raft_consensus.cc:729] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1980b27d22543ca99f6f4f38604ac79, State: Initialized, Role: FOLLOWER
I20260808 17:40:59.845001 13724 consensus_queue.cc:260] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:59.845009 13726 raft_consensus.cc:348] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:59.845067 13726 raft_consensus.cc:374] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:59.845093 13726 raft_consensus.cc:729] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624f2d53e0b548998a5fbb99f5305d38, State: Initialized, Role: FOLLOWER
I20260808 17:40:59.845119 13724 ts_tablet_manager.cc:1428] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:40:59.845163 13726 consensus_queue.cc:260] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:59.845512 13719 tablet_bootstrap.cc:492] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d: No bootstrap required, opened a new log
I20260808 17:40:59.845557 13719 ts_tablet_manager.cc:1397] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 17:40:59.845619 13726 ts_tablet_manager.cc:1428] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:59.845713 13719 raft_consensus.cc:348] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:59.845795 13719 raft_consensus.cc:374] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:59.845820 13719 raft_consensus.cc:729] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0e616806ea2444c832260a0ca77071d, State: Initialized, Role: FOLLOWER
I20260808 17:40:59.845860 13719 consensus_queue.cc:260] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:59.846026 13719 ts_tablet_manager.cc:1428] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:40:59.851353 13694 raft_consensus.cc:482] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:40:59.851411 13694 raft_consensus.cc:504] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:59.851518 13694 leader_election.cc:288] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643), e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397)
I20260808 17:40:59.851681 13023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5d19e086a7402e9d15dd5f9bb77510" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1980b27d22543ca99f6f4f38604ac79" is_pre_election: true
I20260808 17:40:59.851715 13252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5d19e086a7402e9d15dd5f9bb77510" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e616806ea2444c832260a0ca77071d" is_pre_election: true
I20260808 17:40:59.851768 13023 raft_consensus.cc:2454] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 0.
I20260808 17:40:59.851778 13252 raft_consensus.cc:2454] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 0.
I20260808 17:40:59.851943 13384 leader_election.cc:302] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624f2d53e0b548998a5fbb99f5305d38, e1980b27d22543ca99f6f4f38604ac79; no voters:
I20260808 17:40:59.852044 13694 raft_consensus.cc:2781] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:40:59.852078 13694 raft_consensus.cc:482] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:40:59.852097 13694 raft_consensus.cc:3037] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:59.852095 12724 catalog_manager.cc:4841] TS 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195:43937): tablet 02d0b317fac049cead752af7f2a52ba7 (table test-table [id=9f3bc6d123c94e1086f10b94ddb96270]) successfully deleted
I20260808 17:40:59.852121 12729 catalog_manager.cc:4841] TS e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643): tablet 02d0b317fac049cead752af7f2a52ba7 (table test-table [id=9f3bc6d123c94e1086f10b94ddb96270]) successfully deleted
I20260808 17:40:59.852418 12727 catalog_manager.cc:4841] TS e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397): tablet 02d0b317fac049cead752af7f2a52ba7 (table test-table [id=9f3bc6d123c94e1086f10b94ddb96270]) successfully deleted
I20260808 17:40:59.924696 13694 raft_consensus.cc:504] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:59.924896 13694 leader_election.cc:288] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 election: Requested vote from peers e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643), e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397)
I20260808 17:40:59.925117 13252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5d19e086a7402e9d15dd5f9bb77510" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e616806ea2444c832260a0ca77071d"
I20260808 17:40:59.925212 13252 raft_consensus.cc:3037] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:59.925150 13023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5d19e086a7402e9d15dd5f9bb77510" candidate_uuid: "624f2d53e0b548998a5fbb99f5305d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1980b27d22543ca99f6f4f38604ac79"
I20260808 17:40:59.925266 13023 raft_consensus.cc:3037] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:40:59.925899 13252 raft_consensus.cc:2454] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 1.
I20260808 17:40:59.926029 13023 raft_consensus.cc:2454] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624f2d53e0b548998a5fbb99f5305d38 in term 1.
I20260808 17:40:59.926148 13382 leader_election.cc:302] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624f2d53e0b548998a5fbb99f5305d38, e0e616806ea2444c832260a0ca77071d; no voters:
I20260808 17:40:59.926247 13694 raft_consensus.cc:2781] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:40:59.926285 13694 raft_consensus.cc:686] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 LEADER]: Becoming Leader. State: Replica: 624f2d53e0b548998a5fbb99f5305d38, State: Running, Role: LEADER
I20260808 17:40:59.926334 13694 consensus_queue.cc:237] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:59.926909 12746 catalog_manager.cc:5495] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195). New cstate: current_term: 1 leader_uuid: "624f2d53e0b548998a5fbb99f5305d38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } health_report { overall_health: HEALTHY } } }
I20260808 17:40:59.938701 13738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:40:59.936504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40592 (local address 127.9.187.195:43937)
0808 17:40:59.936676 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 17:40:59.936678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:40:59.936685 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:40:59.936704 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:40:59.936704 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:40:59.936713 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:40:59.936768 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:40:59.936884 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:59.937368 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:59.938079 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:40:59.938345 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:40:59.938400 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:40:59.938515 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:40:59.938540 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:40:59.938578 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 17:40:59.938610 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 17:40:59.938628 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":117,"threads_started":1}
I20260808 17:40:59.940747 13252 raft_consensus.cc:1261] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Refusing update from remote peer 624f2d53e0b548998a5fbb99f5305d38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:59.940933 13023 raft_consensus.cc:1261] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Refusing update from remote peer 624f2d53e0b548998a5fbb99f5305d38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:40:59.941126 13697 consensus_queue.cc:1035] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:59.941231 13694 consensus_queue.cc:1035] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:40:59.950785 12746 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:40:59.950889 12746 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:40:59.951457 12746 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092: Sending DeleteTablet for 3 replicas of tablet 4d5d19e086a7402e9d15dd5f9bb77510
I20260808 17:40:59.951722 12988 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d5d19e086a7402e9d15dd5f9bb77510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:59 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:51598
I20260808 17:40:59.951727 13224 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d5d19e086a7402e9d15dd5f9bb77510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:59 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:43122
I20260808 17:40:59.951814 13462 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d5d19e086a7402e9d15dd5f9bb77510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:40:59 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:40564
I20260808 17:40:59.951854 13707 tablet_replica.cc:330] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79: stopping tablet replica
I20260808 17:40:59.951910 13708 tablet_replica.cc:330] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38: stopping tablet replica
I20260808 17:40:59.951923 13707 raft_consensus.cc:2229] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:40:59.951965 13708 raft_consensus.cc:2229] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:40:59.951970 13707 raft_consensus.cc:2258] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:59.952030 13708 raft_consensus.cc:2258] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:59.952047 13706 tablet_replica.cc:330] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d: stopping tablet replica
I20260808 17:40:59.952107 13706 raft_consensus.cc:2229] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:40:59.952148 13706 raft_consensus.cc:2258] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:40:59.952239 12746 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:40:59.952397 12746 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:40:59.952668 13706 ts_tablet_manager.cc:1905] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:59.953048 13707 ts_tablet_manager.cc:1905] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:59.953711 13224 tablet_service.cc:1467] Processing CreateTablet for tablet 951ec37a281e4be19b21890a7f7e1ddc (DEFAULT_TABLE table=test-table [id=ef5b0b50c2e1469285c1dd590edace6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:59.953732 12988 tablet_service.cc:1467] Processing CreateTablet for tablet 951ec37a281e4be19b21890a7f7e1ddc (DEFAULT_TABLE table=test-table [id=ef5b0b50c2e1469285c1dd590edace6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:59.953969 13708 ts_tablet_manager.cc:1905] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:40:59.954057 13462 tablet_service.cc:1467] Processing CreateTablet for tablet 951ec37a281e4be19b21890a7f7e1ddc (DEFAULT_TABLE table=test-table [id=ef5b0b50c2e1469285c1dd590edace6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:40:59.954181 13462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 951ec37a281e4be19b21890a7f7e1ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:40:59.955030 13726 tablet_bootstrap.cc:492] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38: Bootstrap starting.
I20260808 17:40:59.955314 13726 tablet_bootstrap.cc:654] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38: Neither blocks nor log segments found. Creating new log.
I20260808 17:40:59.955775 13726 tablet_bootstrap.cc:492] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38: No bootstrap required, opened a new log
I20260808 17:40:59.955812 13726 ts_tablet_manager.cc:1397] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:40:59.955919 13726 raft_consensus.cc:348] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:59.955984 13726 raft_consensus.cc:374] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:40:59.956003 13726 raft_consensus.cc:729] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624f2d53e0b548998a5fbb99f5305d38, State: Initialized, Role: FOLLOWER
I20260808 17:40:59.956040 13726 consensus_queue.cc:260] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:40:59.956128 13726 ts_tablet_manager.cc:1428] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:00.027177 13224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 951ec37a281e4be19b21890a7f7e1ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:00.027170 12988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 951ec37a281e4be19b21890a7f7e1ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:00.028570 13724 tablet_bootstrap.cc:492] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79: Bootstrap starting.
I20260808 17:41:00.028570 13719 tablet_bootstrap.cc:492] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d: Bootstrap starting.
I20260808 17:41:00.028995 13724 tablet_bootstrap.cc:654] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:00.028996 13719 tablet_bootstrap.cc:654] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:00.029417 13707 ts_tablet_manager.cc:1918] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:41:00.029475 13707 log.cc:1196] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-0/wal/wals/4d5d19e086a7402e9d15dd5f9bb77510
I20260808 17:41:00.029671 13707 ts_tablet_manager.cc:1939] T 4d5d19e086a7402e9d15dd5f9bb77510 P e1980b27d22543ca99f6f4f38604ac79: Deleting consensus metadata
I20260808 17:41:00.030174 13706 ts_tablet_manager.cc:1918] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:41:00.030231 13706 log.cc:1196] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/4d5d19e086a7402e9d15dd5f9bb77510
I20260808 17:41:00.030275 13724 tablet_bootstrap.cc:492] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79: No bootstrap required, opened a new log
I20260808 17:41:00.030320 13724 ts_tablet_manager.cc:1397] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:00.030426 13706 ts_tablet_manager.cc:1939] T 4d5d19e086a7402e9d15dd5f9bb77510 P e0e616806ea2444c832260a0ca77071d: Deleting consensus metadata
I20260808 17:41:00.030443 13724 raft_consensus.cc:348] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:41:00.030507 13724 raft_consensus.cc:374] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:00.030524 13724 raft_consensus.cc:729] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1980b27d22543ca99f6f4f38604ac79, State: Initialized, Role: FOLLOWER
I20260808 17:41:00.030566 13724 consensus_queue.cc:260] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:41:00.030649 13724 ts_tablet_manager.cc:1428] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:00.030685 13719 tablet_bootstrap.cc:492] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d: No bootstrap required, opened a new log
I20260808 17:41:00.030725 13719 ts_tablet_manager.cc:1397] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260808 17:41:00.030895 13719 raft_consensus.cc:348] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:41:00.030967 13719 raft_consensus.cc:374] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:00.030985 13719 raft_consensus.cc:729] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0e616806ea2444c832260a0ca77071d, State: Initialized, Role: FOLLOWER
I20260808 17:41:00.031001 13708 ts_tablet_manager.cc:1918] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:41:00.031019 13719 consensus_queue.cc:260] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:41:00.031057 13708 log.cc:1196] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/4d5d19e086a7402e9d15dd5f9bb77510
I20260808 17:41:00.031100 13719 ts_tablet_manager.cc:1428] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:00.031260 13708 ts_tablet_manager.cc:1939] T 4d5d19e086a7402e9d15dd5f9bb77510 P 624f2d53e0b548998a5fbb99f5305d38: Deleting consensus metadata
I20260808 17:41:00.036127 13735 raft_consensus.cc:482] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:00.036188 13735 raft_consensus.cc:504] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:41:00.036247 12724 catalog_manager.cc:4841] TS 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195:43937): tablet 4d5d19e086a7402e9d15dd5f9bb77510 (table test-table [id=98afb61973bf4da1a3d691c20bb88456]) successfully deleted
I20260808 17:41:00.036516 13735 leader_election.cc:288] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643), 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195:43937)
I20260808 17:41:00.040485 13738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:00.036770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:43479 (local address 127.9.187.195:43937)
0808 17:41:00.036818 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:00.036820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:00.036934 (+ 114us) server_negotiation.cc:407] Connection header received
0808 17:41:00.037004 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:00.037005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:00.037014 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:00.037080 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:00.037255 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.038005 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.039551 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.040128 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.040210 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:00.040220 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:00.040375 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 17:41:00.040413 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:41:00.040539 13751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:00.036745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:57473 (local address 127.9.187.193:42643)
0808 17:41:00.036870 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:00.036872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:00.036923 (+ 51us) server_negotiation.cc:407] Connection header received
0808 17:41:00.037001 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:00.037002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:00.037014 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:00.037085 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:00.037256 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.038005 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.039565 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.040145 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.040212 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:00.040220 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:00.040374 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 17:41:00.040413 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":52,"threads_started":1}
I20260808 17:41:00.040513 13747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:00.036687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:42643 (local address 127.9.187.194:57473)
0808 17:41:00.036846 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:00.036858 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:00.036932 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:00.037093 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:00.037093 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:00.037095 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:00.037177 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:00.037179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.038148 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.038149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:00.039468 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:00.039472 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.040217 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.040218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:00.040302 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:00.040307 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:41:00.040364 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 17:41:00.040408 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":8,"thread_start_us":83,"threads_started":1}
I20260808 17:41:00.040764 13023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951ec37a281e4be19b21890a7f7e1ddc" candidate_uuid: "e0e616806ea2444c832260a0ca77071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1980b27d22543ca99f6f4f38604ac79" is_pre_election: true
I20260808 17:41:00.040845 13023 raft_consensus.cc:2454] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0e616806ea2444c832260a0ca77071d in term 0.
I20260808 17:41:00.040519 13748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:00.036694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:43937 (local address 127.9.187.194:43479)
0808 17:41:00.036862 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:00.036873 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:00.036932 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:00.037092 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:00.037093 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:00.037097 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:00.037186 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:00.037188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.038106 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.038107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:00.039468 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:00.039472 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.040219 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.040219 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:00.040307 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:00.040309 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:41:00.040364 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 17:41:00.040408 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":96,"thread_start_us":99,"threads_started":1}
I20260808 17:41:00.041069 13493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951ec37a281e4be19b21890a7f7e1ddc" candidate_uuid: "e0e616806ea2444c832260a0ca77071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624f2d53e0b548998a5fbb99f5305d38" is_pre_election: true
I20260808 17:41:00.041169 13493 raft_consensus.cc:2454] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0e616806ea2444c832260a0ca77071d in term 0.
I20260808 17:41:00.041314 13153 leader_election.cc:302] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0e616806ea2444c832260a0ca77071d, e1980b27d22543ca99f6f4f38604ac79; no voters:
I20260808 17:41:00.041463 13735 raft_consensus.cc:2781] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:41:00.041513 13735 raft_consensus.cc:482] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:00.041527 13735 raft_consensus.cc:3037] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:00.059759 12729 catalog_manager.cc:4841] TS e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643): tablet 4d5d19e086a7402e9d15dd5f9bb77510 (table test-table [id=98afb61973bf4da1a3d691c20bb88456]) successfully deleted
I20260808 17:41:00.079799 12727 catalog_manager.cc:4841] TS e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397): tablet 4d5d19e086a7402e9d15dd5f9bb77510 (table test-table [id=98afb61973bf4da1a3d691c20bb88456]) successfully deleted
I20260808 17:41:00.128362 13735 raft_consensus.cc:504] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:41:00.128623 13735 leader_election.cc:288] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [CANDIDATE]: Term 1 election: Requested vote from peers e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643), 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195:43937)
I20260808 17:41:00.128885 13493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951ec37a281e4be19b21890a7f7e1ddc" candidate_uuid: "e0e616806ea2444c832260a0ca77071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624f2d53e0b548998a5fbb99f5305d38"
I20260808 17:41:00.128887 13023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951ec37a281e4be19b21890a7f7e1ddc" candidate_uuid: "e0e616806ea2444c832260a0ca77071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1980b27d22543ca99f6f4f38604ac79"
I20260808 17:41:00.128981 13023 raft_consensus.cc:3037] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:00.128983 13493 raft_consensus.cc:3037] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:00.129719 13493 raft_consensus.cc:2454] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0e616806ea2444c832260a0ca77071d in term 1.
I20260808 17:41:00.129774 13023 raft_consensus.cc:2454] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0e616806ea2444c832260a0ca77071d in term 1.
I20260808 17:41:00.129946 13148 leader_election.cc:302] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624f2d53e0b548998a5fbb99f5305d38, e0e616806ea2444c832260a0ca77071d; no voters:
I20260808 17:41:00.130064 13735 raft_consensus.cc:2781] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:00.130272 13735 raft_consensus.cc:686] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 1 LEADER]: Becoming Leader. State: Replica: e0e616806ea2444c832260a0ca77071d, State: Running, Role: LEADER
I20260808 17:41:00.130363 13735 consensus_queue.cc:237] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } }
I20260808 17:41:00.131147 12746 catalog_manager.cc:5495] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d reported cstate change: term changed from 0 to 1, leader changed from <none> to e0e616806ea2444c832260a0ca77071d (127.9.187.194). New cstate: current_term: 1 leader_uuid: "e0e616806ea2444c832260a0ca77071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0e616806ea2444c832260a0ca77071d" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 } health_report { overall_health: UNKNOWN } } }
I20260808 17:41:00.141615 13755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:00.139410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43130 (local address 127.9.187.194:42397)
0808 17:41:00.139565 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:00.139567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:00.139574 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:41:00.139606 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:00.139606 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:00.139624 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:00.139701 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:00.139788 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.140269 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.141008 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.141222 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.141273 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:00.141365 (+ 92us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:00.141469 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:00.141516 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:00.141535 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 17:41:00.141550 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
I20260808 17:41:00.146005 13751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:00.143820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:57967 (local address 127.9.187.193:42643)
0808 17:41:00.143857 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:00.143859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:00.144013 (+ 154us) server_negotiation.cc:407] Connection header received
0808 17:41:00.144063 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:00.144063 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:00.144071 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:00.144113 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:00.144218 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.144659 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.145336 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.145509 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.145553 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:00.145847 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:00.145871 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:00.145903 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:00.145937 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 17:41:00.145953 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:41:00.146070 13758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:00.143762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:42643 (local address 127.9.187.194:57967)
0808 17:41:00.143954 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:00.143965 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:00.144025 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:00.144121 (+ 96us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:00.144121 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:00.144122 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:41:00.144178 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:00.144180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.144704 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.144704 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:00.145279 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:00.145281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.145650 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.145651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:00.145770 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:00.145784 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:41:00.145905 (+ 121us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:41:00.145906 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:41:00.145934 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 17:41:00.145970 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":62,"threads_started":1}
I20260808 17:41:00.148066 13023 raft_consensus.cc:1261] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Refusing update from remote peer e0e616806ea2444c832260a0ca77071d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:00.148108 13493 raft_consensus.cc:1261] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Refusing update from remote peer e0e616806ea2444c832260a0ca77071d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:00.148463 13752 consensus_queue.cc:1035] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1980b27d22543ca99f6f4f38604ac79" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 42643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:00.148622 13735 consensus_queue.cc:1035] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "624f2d53e0b548998a5fbb99f5305d38" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 43937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:00.160868 13765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:00.158145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:42397 (local address 127.9.187.193:34451)
0808 17:41:00.158292 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:00.158303 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:00.158350 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:00.158486 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:00.158486 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:00.158487 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:41:00.158540 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:00.158541 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.159345 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.159346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:00.160143 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:00.160146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.160583 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.160584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:00.160625 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:00.160628 (+ 3us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:41:00.160751 (+ 123us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:41:00.160752 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:41:00.160780 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 17:41:00.160812 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":98,"threads_started":1}
I20260808 17:41:00.160873 13755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:00.158332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:34451 (local address 127.9.187.194:42397)
0808 17:41:00.158372 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:00.158375 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:00.158385 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:00.158406 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:00.158407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:00.158418 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:00.158484 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:00.158578 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.159251 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.160216 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:00.160511 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:00.160578 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:00.160667 (+ 89us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:00.160698 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:00.160752 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:00.160784 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 17:41:00.160802 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 17:41:00.161280 13682 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 17:41:01.685150 12748 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:01.685294 12748 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:01.686177 12748 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e0c64b0d6c2434f83369393100f7092: Sending DeleteTablet for 3 replicas of tablet 951ec37a281e4be19b21890a7f7e1ddc
I20260808 17:41:01.686432 12988 tablet_service.cc:1514] Processing DeleteTablet for tablet 951ec37a281e4be19b21890a7f7e1ddc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:01 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:51598
I20260808 17:41:01.686450 13462 tablet_service.cc:1514] Processing DeleteTablet for tablet 951ec37a281e4be19b21890a7f7e1ddc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:01 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:40564
I20260808 17:41:01.686493 13224 tablet_service.cc:1514] Processing DeleteTablet for tablet 951ec37a281e4be19b21890a7f7e1ddc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:01 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:43122
I20260808 17:41:01.686657 13806 tablet_replica.cc:330] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d: stopping tablet replica
I20260808 17:41:01.686661 13805 tablet_replica.cc:330] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79: stopping tablet replica
I20260808 17:41:01.686720 13806 raft_consensus.cc:2229] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:41:01.686781 13805 raft_consensus.cc:2229] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:01.686813 13806 raft_consensus.cc:2258] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:01.686844 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 12869
I20260808 17:41:01.686866 13805 raft_consensus.cc:2258] T 951ec37a281e4be19b21890a7f7e1ddc P e1980b27d22543ca99f6f4f38604ac79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:01.686815 13808 tablet_replica.cc:330] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38: stopping tablet replica
I20260808 17:41:01.691504 13808 raft_consensus.cc:2229] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:01.691550 13808 raft_consensus.cc:2258] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:01.691602 13806 ts_tablet_manager.cc:1905] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:01.693131 13806 ts_tablet_manager.cc:1918] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 17:41:01.693172 13806 log.cc:1196] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/951ec37a281e4be19b21890a7f7e1ddc
I20260808 17:41:01.693399 13806 ts_tablet_manager.cc:1939] T 951ec37a281e4be19b21890a7f7e1ddc P e0e616806ea2444c832260a0ca77071d: Deleting consensus metadata
I20260808 17:41:01.693638 12727 catalog_manager.cc:4841] TS e0e616806ea2444c832260a0ca77071d (127.9.187.194:42397): tablet 951ec37a281e4be19b21890a7f7e1ddc (table test-table [id=ef5b0b50c2e1469285c1dd590edace6c]) successfully deleted
I20260808 17:41:01.694968 13808 ts_tablet_manager.cc:1905] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:01.696094 13808 ts_tablet_manager.cc:1918] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 17:41:01.696135 13808 log.cc:1196] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/951ec37a281e4be19b21890a7f7e1ddc
I20260808 17:41:01.696321 13808 ts_tablet_manager.cc:1939] T 951ec37a281e4be19b21890a7f7e1ddc P 624f2d53e0b548998a5fbb99f5305d38: Deleting consensus metadata
I20260808 17:41:01.705729 12724 catalog_manager.cc:4841] TS 624f2d53e0b548998a5fbb99f5305d38 (127.9.187.195:43937): tablet 951ec37a281e4be19b21890a7f7e1ddc (table test-table [id=ef5b0b50c2e1469285c1dd590edace6c]) successfully deleted
W20260808 17:41:01.710435 12729 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:42643 (error 108)
I20260808 17:41:01.710995 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 13110
I20260808 17:41:01.711024 13810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:01.710801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:42643 (local address 127.0.0.1:51612)
0808 17:41:01.710925 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:01.710979 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:42643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":65,"threads_started":1}
W20260808 17:41:01.711126 12729 catalog_manager.cc:4584] TS e1980b27d22543ca99f6f4f38604ac79 (127.9.187.193:42643): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 951ec37a281e4be19b21890a7f7e1ddc: Network error: Client connection negotiation failed: client connection to 127.9.187.193:42643: connect: Connection refused (error 111)
I20260808 17:41:01.721973 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 13355
I20260808 17:41:01.732229 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 12703
2026-08-08T17:41:01Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5918 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:01 dist-test-slave-bqcl krb5kdc[13816](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:01 dist-test-slave-bqcl krb5kdc[13816](info): set up 2 sockets
Aug 08 17:41:01 dist-test-slave-bqcl krb5kdc[13816](info): commencing operation
krb5kdc: starting...
W20260808 17:41:02.897965 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:02 dist-test-slave-bqcl krb5kdc[13816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:41:03.014592 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:39107
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:39107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:03.096100 13841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:03.096438 13841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:03.096489 13841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:03.098033 13841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:03.098078 13841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:03.098091 13841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:03.098104 13841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:03.098135 13841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:03.099830 13841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:39107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:39107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:03.100075 13841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:03.100302 13841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:03.105334 13847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:03.105392 13853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:03.105408 13848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:03.105399 13841 server_base.cc:1034] running on GCE node
I20260808 17:41:03.105875 13841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:03.106189 13841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:03.107343 13841 hybrid_clock.cc:648] HybridClock initialized: now 1786210863107326 us; error 34 us; skew 500 ppm
Aug 08 17:41:03 dist-test-slave-bqcl krb5kdc[13816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210863, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:03.109853 13841 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:41:03.110324 13841 webserver.cc:460] Webserver started at http://127.9.187.254:40083/ using document root <none> and password file <none>
I20260808 17:41:03.110526 13841 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:03.110569 13841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:03.110684 13841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:03.111692 13841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "0f2d29a8c8cf49f99ab935e2e545a8b5"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "3437d0c672f905bc213b98316df610d0"
server_key_iv: "6012cbe77cd230fa2d646fb7272aa6be"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.111994 13841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "0f2d29a8c8cf49f99ab935e2e545a8b5"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "3437d0c672f905bc213b98316df610d0"
server_key_iv: "6012cbe77cd230fa2d646fb7272aa6be"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.113211 13841 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:41:03.113878 13867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:03.114022 13841 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:03.114106 13841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "0f2d29a8c8cf49f99ab935e2e545a8b5"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "3437d0c672f905bc213b98316df610d0"
server_key_iv: "6012cbe77cd230fa2d646fb7272aa6be"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.114205 13841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:03.121172 13841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:03.123209 13841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:03.123342 13841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:03.127345 13841 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:39107
I20260808 17:41:03.127708 13841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:03.127686 13964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:39107 every 8 connection(s)
I20260808 17:41:03.128342 13965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:03.129169 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 13841
I20260808 17:41:03.129256 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:03.129415 9967 external_mini_cluster.cc:1428] Setting key 1e1dfaec58d32f960b11b21b47dc3afa
I20260808 17:41:03.131353 13965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5: Bootstrap starting.
I20260808 17:41:03.132066 13965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:03.132354 13965 log.cc:824] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:03.133025 13965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5: No bootstrap required, opened a new log
I20260808 17:41:03.135253 13965 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d29a8c8cf49f99ab935e2e545a8b5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39107 } }
I20260808 17:41:03.135388 13965 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:03.135411 13965 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f2d29a8c8cf49f99ab935e2e545a8b5, State: Initialized, Role: FOLLOWER
I20260808 17:41:03.135519 13965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d29a8c8cf49f99ab935e2e545a8b5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39107 } }
I20260808 17:41:03.135602 13965 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:03.135635 13965 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:03.135685 13965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 17:41:03 dist-test-slave-bqcl krb5kdc[13816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:03.136233 13965 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d29a8c8cf49f99ab935e2e545a8b5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39107 } }
I20260808 17:41:03.136332 13965 leader_election.cc:302] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f2d29a8c8cf49f99ab935e2e545a8b5; no voters:
I20260808 17:41:03.136499 13965 leader_election.cc:288] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:03.136565 13976 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:03.136694 13976 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [term 1 LEADER]: Becoming Leader. State: Replica: 0f2d29a8c8cf49f99ab935e2e545a8b5, State: Running, Role: LEADER
I20260808 17:41:03.136781 13965 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:03.136786 13976 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d29a8c8cf49f99ab935e2e545a8b5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39107 } }
I20260808 17:41:03.137420 13976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f2d29a8c8cf49f99ab935e2e545a8b5. Latest consensus state: current_term: 1 leader_uuid: "0f2d29a8c8cf49f99ab935e2e545a8b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d29a8c8cf49f99ab935e2e545a8b5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39107 } } }
I20260808 17:41:03.137495 13976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:03.137827 13980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f2d29a8c8cf49f99ab935e2e545a8b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d29a8c8cf49f99ab935e2e545a8b5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39107 } } }
I20260808 17:41:03.137902 13980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:03.138015 13982 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:03.138671 13982 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:03.140966 13974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:03.129901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37698 (local address 127.9.187.254:39107)
0808 17:41:03.130077 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:03.130095 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:03.130151 (+ 56us) server_negotiation.cc:407] Connection header received
0808 17:41:03.130616 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:03.130626 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:03.130694 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:03.130842 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:03.131415 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.132701 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.133471 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.134096 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.134240 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:03.136564 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:03.136569 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:03.136570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:03.136583 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:03.139369 (+ 2786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:03.139765 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:03.139768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:03.139768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:03.139883 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:03.140131 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:03.140132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:03.140132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:03.140388 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:03.140509 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:03.140650 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 17:41:03.140764 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":76,"threads_started":1}
I20260808 17:41:03.142194 13982 catalog_manager.cc:1347] Generated new cluster ID: 49586d3196eb4519a54ed5d8ba3e2de8
I20260808 17:41:03.142243 13982 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:03.152006 13982 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:03.152525 13982 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:03.156932 13982 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f2d29a8c8cf49f99ab935e2e545a8b5: Generated new TSK 0
I20260808 17:41:03.157100 13982 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:41:03.190022 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39107
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:03.297946 14018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:03.298172 14018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:03.298197 14018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:03.299327 14018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:03.299369 14018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:03.299396 14018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:03.300801 14018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:03.301043 14018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:03.301261 14018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:03.306012 14024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:03.306066 14027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:03.306025 14029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:03.306088 14018 server_base.cc:1034] running on GCE node
I20260808 17:41:03.306424 14018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:03.306667 14018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:03.307804 14018 hybrid_clock.cc:648] HybridClock initialized: now 1786210863307790 us; error 33 us; skew 500 ppm
Aug 08 17:41:03 dist-test-slave-bqcl krb5kdc[13816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210863, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:03.310168 14018 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:41:03.310600 14018 webserver.cc:460] Webserver started at http://127.9.187.193:46363/ using document root <none> and password file <none>
I20260808 17:41:03.310820 14018 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:03.310864 14018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:03.310990 14018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:03.311988 14018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "264f0bb3ac2e44ed9e769a2d3a41a1d6"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "f7ff6e9c8d5b064d4239209b310bae79"
server_key_iv: "5daed2422e196bffc523eb198fe2d628"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.312309 14018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "264f0bb3ac2e44ed9e769a2d3a41a1d6"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "f7ff6e9c8d5b064d4239209b310bae79"
server_key_iv: "5daed2422e196bffc523eb198fe2d628"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.313560 14018 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:41:03.314278 14039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:03.314425 14018 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:03.314504 14018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "264f0bb3ac2e44ed9e769a2d3a41a1d6"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "f7ff6e9c8d5b064d4239209b310bae79"
server_key_iv: "5daed2422e196bffc523eb198fe2d628"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.314601 14018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:03.320847 14018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:03.322468 14018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:03.322595 14018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:03.322783 14018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:03.323062 14018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:03.323096 14018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:03.323115 14018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:03.323137 14018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:03.328855 14018 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:32979
I20260808 17:41:03.328918 14220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:32979 every 8 connection(s)
I20260808 17:41:03.329185 14018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:41:03 dist-test-slave-bqcl krb5kdc[13816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210863, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:03.336076 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 14018
I20260808 17:41:03.336179 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:03.336355 9967 external_mini_cluster.cc:1428] Setting key ddd544b6a7712c6768130ab11b218453
I20260808 17:41:03.338164 13974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:03.329834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:45467 (local address 127.9.187.254:39107)
0808 17:41:03.329882 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:03.329884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:03.330056 (+ 172us) server_negotiation.cc:407] Connection header received
0808 17:41:03.330587 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:03.330588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:03.330601 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:03.330651 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:03.331593 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.332097 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.333082 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.333299 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.333356 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:03.335376 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:03.335378 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:03.335378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:03.335386 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:03.336764 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:03.337210 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:03.337210 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:03.337211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:03.337274 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:03.337520 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:03.337520 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:03.337520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:03.337615 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:03.337668 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:03.337960 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 17:41:03.338051 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:41:03.338369 14225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:03.329806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:39107 (local address 127.9.187.193:45467)
0808 17:41:03.329939 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:03.329978 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:03.330485 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:03.330742 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:03.330747 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:03.331306 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:03.331495 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:03.331500 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.332183 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.332185 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:03.332992 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:03.332994 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.333372 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.333373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:03.333492 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:03.333930 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:03.333938 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:03.335287 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:03.336834 (+ 1547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:03.336841 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:03.336842 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:03.337130 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:03.337329 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:03.337330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:03.337330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:03.337462 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:03.337698 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:03.337706 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:03.337830 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 17:41:03.337913 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 17:41:03.338074 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
I20260808 17:41:03.339102 14221 heartbeater.cc:347] Connected to a master server at 127.9.187.254:39107
I20260808 17:41:03.339198 14221 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:03.339376 14221 heartbeater.cc:511] Master 127.9.187.254:39107 requested a full tablet report, sending...
I20260808 17:41:03.339872 13891 ts_manager.cc:194] Registered new tserver with Master: 264f0bb3ac2e44ed9e769a2d3a41a1d6 (127.9.187.193:32979)
I20260808 17:41:03.340698 13891 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:45467
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:41:03.361047 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39107
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:03.444149 14228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:03.444371 14228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:03.444406 14228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:03.445567 14228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:03.445616 14228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:03.445653 14228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:03.447117 14228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:03.447363 14228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:03.447593 14228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:03.452467 14234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:03.452476 14240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:03.452481 14237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:03.452603 14228 server_base.cc:1034] running on GCE node
I20260808 17:41:03.452915 14228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:03.453153 14228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:03.454290 14228 hybrid_clock.cc:648] HybridClock initialized: now 1786210863454275 us; error 28 us; skew 500 ppm
Aug 08 17:41:03 dist-test-slave-bqcl krb5kdc[13816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210863, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:03.459810 14228 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:41:03.460264 14228 webserver.cc:460] Webserver started at http://127.9.187.194:38859/ using document root <none> and password file <none>
I20260808 17:41:03.460461 14228 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:03.460510 14228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:03.460639 14228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:03.461652 14228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "d74809d7b6dd4b539438ae814b876652"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "2b295003e9718f732be35e47cf7f8a70"
server_key_iv: "c4d0d400d59b83ae42e0cc7c0cb804f9"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.461982 14228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "d74809d7b6dd4b539438ae814b876652"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "2b295003e9718f732be35e47cf7f8a70"
server_key_iv: "c4d0d400d59b83ae42e0cc7c0cb804f9"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.463249 14228 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:41:03.463925 14252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:03.464079 14228 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:03.464165 14228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "d74809d7b6dd4b539438ae814b876652"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "2b295003e9718f732be35e47cf7f8a70"
server_key_iv: "c4d0d400d59b83ae42e0cc7c0cb804f9"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.464231 14228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:03.472496 14228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:03.474601 14228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:03.474732 14228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:03.474933 14228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:03.475215 14228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:03.475250 14228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:03.475277 14228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:03.475303 14228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:03.480715 14228 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:34431
I20260808 17:41:03.480773 14433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:34431 every 8 connection(s)
I20260808 17:41:03.481050 14228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:41:03.485854 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 14228
I20260808 17:41:03.485949 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:03.486155 9967 external_mini_cluster.cc:1428] Setting key 01037a29c35ba55901c9746de555a05a
Aug 08 17:41:03 dist-test-slave-bqcl krb5kdc[13816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210863, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:03.489964 13974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:03.481722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:42473 (local address 127.9.187.254:39107)
0808 17:41:03.481778 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:03.481781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:03.481982 (+ 201us) server_negotiation.cc:407] Connection header received
0808 17:41:03.482487 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:03.482488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:03.482497 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:03.482534 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:03.483429 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.483980 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.484915 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.485097 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.485141 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:03.487409 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:03.487410 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:03.487411 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:03.487417 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:03.488666 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:03.489104 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:03.489104 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:03.489105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:03.489154 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:03.489392 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:03.489392 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:03.489392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:03.489485 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:03.489528 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:03.489833 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 17:41:03.489898 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:41:03.490162 14437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:03.481696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:39107 (local address 127.9.187.194:42473)
0808 17:41:03.481861 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:03.481903 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:03.482391 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:03.482594 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:03.482598 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:03.483148 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:03.483349 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:03.483355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.484045 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.484046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:03.484850 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:03.484853 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.485150 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.485151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:03.485262 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:03.485642 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:03.485650 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:03.487321 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:03.488745 (+ 1424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:03.488753 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:03.488755 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:03.489037 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:03.489207 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:03.489208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:03.489208 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:03.489337 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:03.489533 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:03.489546 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:03.489705 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 17:41:03.489812 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 17:41:03.489939 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260808 17:41:03.490656 14435 heartbeater.cc:347] Connected to a master server at 127.9.187.254:39107
I20260808 17:41:03.490769 14435 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:03.490952 14435 heartbeater.cc:511] Master 127.9.187.254:39107 requested a full tablet report, sending...
I20260808 17:41:03.491300 13891 ts_manager.cc:194] Registered new tserver with Master: d74809d7b6dd4b539438ae814b876652 (127.9.187.194:34431)
I20260808 17:41:03.491719 13891 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:42473
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:41:03.512223 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39107
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:03.594260 14440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:03.594470 14440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:03.594506 14440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:03.595634 14440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:03.595678 14440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:03.595705 14440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:03.597081 14440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:03.597314 14440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:03.597545 14440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:41:03.602443 14440 server_base.cc:1034] running on GCE node
W20260808 17:41:03.602402 14450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:03.602372 14454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:03.602427 14451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:03.602854 14440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:03.603098 14440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:03.604255 14440 hybrid_clock.cc:648] HybridClock initialized: now 1786210863604239 us; error 32 us; skew 500 ppm
Aug 08 17:41:03 dist-test-slave-bqcl krb5kdc[13816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210863, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:03.606772 14440 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:41:03.607224 14440 webserver.cc:460] Webserver started at http://127.9.187.195:34453/ using document root <none> and password file <none>
I20260808 17:41:03.607424 14440 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:03.607475 14440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:03.607621 14440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:03.608633 14440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "b6d14d9c9a1c411f9d14d69d31d5064e"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "ea6dd2a41c48b8a5c634d9694d68ad7e"
server_key_iv: "ce3a8546f23267dd5887ae3b0b61c45c"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.608979 14440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "b6d14d9c9a1c411f9d14d69d31d5064e"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "ea6dd2a41c48b8a5c634d9694d68ad7e"
server_key_iv: "ce3a8546f23267dd5887ae3b0b61c45c"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.610327 14440 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:41:03.611094 14463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:03.611268 14440 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:03.611356 14440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "b6d14d9c9a1c411f9d14d69d31d5064e"
format_stamp: "Formatted at 2026-08-08 17:41:03 on dist-test-slave-bqcl"
server_key: "ea6dd2a41c48b8a5c634d9694d68ad7e"
server_key_iv: "ce3a8546f23267dd5887ae3b0b61c45c"
server_key_version: "encryptionkey@0"
I20260808 17:41:03.611419 14440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:03.623531 14440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:03.625662 14440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:03.625806 14440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:03.626036 14440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:03.626367 14440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:03.626415 14440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:03.626451 14440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:03.626474 14440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:03.632635 14440 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:34915
I20260808 17:41:03.632683 14659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:34915 every 8 connection(s)
I20260808 17:41:03.633018 14440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:41:03.637171 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 14440
I20260808 17:41:03.637264 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:03.637483 9967 external_mini_cluster.cc:1428] Setting key c047f88e3662928fec1ef34367428754
Aug 08 17:41:03 dist-test-slave-bqcl krb5kdc[13816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210863, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:03.642349 13974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:03.633716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:60881 (local address 127.9.187.254:39107)
0808 17:41:03.633768 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:03.633770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:03.633975 (+ 205us) server_negotiation.cc:407] Connection header received
0808 17:41:03.634545 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:03.634546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:03.634558 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:03.634609 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:03.635512 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.636012 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.637034 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.637230 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.637326 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:03.639719 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:03.639720 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:03.639720 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:03.639727 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:03.641068 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:03.641433 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:03.641434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:03.641434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:03.641494 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:03.641729 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:03.641731 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:03.641731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:03.641854 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:03.641919 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:03.642199 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 17:41:03.642277 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:41:03.642505 14662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:03.633689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:39107 (local address 127.9.187.195:60881)
0808 17:41:03.633857 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:03.633893 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:03.634448 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:03.634692 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:03.634695 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:03.635255 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:03.635442 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:03.635447 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.636077 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.636078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:03.636944 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:03.636946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:03.637403 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:03.637404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:03.637542 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:03.638099 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:03.638117 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:03.639632 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:03.641144 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:03.641150 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:03.641151 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:03.641351 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:03.641559 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:03.641560 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:03.641560 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:03.641652 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:03.641924 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:03.641930 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:03.642045 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 17:41:03.642170 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 17:41:03.642301 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":93,"threads_started":1}
I20260808 17:41:03.642918 14660 heartbeater.cc:347] Connected to a master server at 127.9.187.254:39107
I20260808 17:41:03.643000 14660 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:03.643143 14660 heartbeater.cc:511] Master 127.9.187.254:39107 requested a full tablet report, sending...
I20260808 17:41:03.643428 13891 ts_manager.cc:194] Registered new tserver with Master: b6d14d9c9a1c411f9d14d69d31d5064e (127.9.187.195:34915)
I20260808 17:41:03.643791 13891 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:60881
I20260808 17:41:03.649338 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 17:41:03.662081 13974 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:03.661214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37704 (local address 127.9.187.254:39107)
0808 17:41:03.661277 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:03.661279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:03.661420 (+ 141us) server_negotiation.cc:407] Connection header received
0808 17:41:03.661444 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:03.661445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:03.661455 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:03.661498 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:03.662011 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37704: BlockingRecv error: recv got EOF from 127.0.0.1:37704 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 17:41:03.662962 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 14018
I20260808 17:41:03.673539 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 14228
I20260808 17:41:03.683975 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 14440
I20260808 17:41:03.694190 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 13841
2026-08-08T17:41:03Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1962 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:03 dist-test-slave-bqcl krb5kdc[14677](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:03 dist-test-slave-bqcl krb5kdc[14677](info): set up 2 sockets
Aug 08 17:41:03 dist-test-slave-bqcl krb5kdc[14677](info): commencing operation
krb5kdc: starting...
W20260808 17:41:04.844817 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:04 dist-test-slave-bqcl krb5kdc[14677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:41:04.958382 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46429
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:44221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:46429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:05.039343 14701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:05.039559 14701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:05.039590 14701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:05.040726 14701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:05.040766 14701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:05.040784 14701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:05.040802 14701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:05.040815 14701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:05.042343 14701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:44221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:46429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:05.042598 14701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:05.042802 14701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:05.047398 14715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:05.047399 14720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:05.047432 14716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:05.047415 14701 server_base.cc:1034] running on GCE node
I20260808 17:41:05.047811 14701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:05.048102 14701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:05.049254 14701 hybrid_clock.cc:648] HybridClock initialized: now 1786210865049231 us; error 33 us; skew 500 ppm
Aug 08 17:41:05 dist-test-slave-bqcl krb5kdc[14677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210865, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:05.051761 14701 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:41:05.052201 14701 webserver.cc:460] Webserver started at http://127.9.187.254:42813/ using document root <none> and password file <none>
I20260808 17:41:05.052385 14701 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:05.052424 14701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:05.052518 14701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:05.053524 14701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "582917d6410740598227c1cc709f27cd"
format_stamp: "Formatted at 2026-08-08 17:41:05 on dist-test-slave-bqcl"
server_key: "c3c4c95bca945494ee7bf4e58f393599"
server_key_iv: "83038c16cfa033415bf681b3afed8e5e"
server_key_version: "encryptionkey@0"
I20260808 17:41:05.053856 14701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "582917d6410740598227c1cc709f27cd"
format_stamp: "Formatted at 2026-08-08 17:41:05 on dist-test-slave-bqcl"
server_key: "c3c4c95bca945494ee7bf4e58f393599"
server_key_iv: "83038c16cfa033415bf681b3afed8e5e"
server_key_version: "encryptionkey@0"
I20260808 17:41:05.055145 14701 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:41:05.055815 14733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:05.055986 14701 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:05.056089 14701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "582917d6410740598227c1cc709f27cd"
format_stamp: "Formatted at 2026-08-08 17:41:05 on dist-test-slave-bqcl"
server_key: "c3c4c95bca945494ee7bf4e58f393599"
server_key_iv: "83038c16cfa033415bf681b3afed8e5e"
server_key_version: "encryptionkey@0"
I20260808 17:41:05.056144 14701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:05.072571 14701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:05.074425 14701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:05.074539 14701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:05.078361 14701 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:46429
I20260808 17:41:05.078395 14810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:46429 every 8 connection(s)
I20260808 17:41:05.078717 14701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:05.079556 14812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:05.081846 14812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd: Bootstrap starting.
I20260808 17:41:05.082430 14812 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:05.082713 14812 log.cc:824] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:05.083118 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 14701
I20260808 17:41:05.083220 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:05.083384 9967 external_mini_cluster.cc:1428] Setting key e9eee371e0be7ebec451decfa5131fb3
I20260808 17:41:05.083472 14812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd: No bootstrap required, opened a new log
I20260808 17:41:05.086108 14812 raft_consensus.cc:348] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "582917d6410740598227c1cc709f27cd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46429 } }
I20260808 17:41:05.086284 14812 raft_consensus.cc:374] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:05.086321 14812 raft_consensus.cc:729] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 582917d6410740598227c1cc709f27cd, State: Initialized, Role: FOLLOWER
I20260808 17:41:05.086441 14812 consensus_queue.cc:260] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "582917d6410740598227c1cc709f27cd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46429 } }
I20260808 17:41:05.086511 14812 raft_consensus.cc:388] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:05.086541 14812 raft_consensus.cc:482] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:05.086588 14812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:05.087201 14812 raft_consensus.cc:504] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "582917d6410740598227c1cc709f27cd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46429 } }
I20260808 17:41:05.087313 14812 leader_election.cc:302] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 582917d6410740598227c1cc709f27cd; no voters:
I20260808 17:41:05.087464 14812 leader_election.cc:288] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:05.087515 14818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:05.087738 14818 raft_consensus.cc:686] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [term 1 LEADER]: Becoming Leader. State: Replica: 582917d6410740598227c1cc709f27cd, State: Running, Role: LEADER
I20260808 17:41:05.087759 14812 sys_catalog.cc:564] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:05.087878 14818 consensus_queue.cc:237] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "582917d6410740598227c1cc709f27cd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46429 } }
I20260808 17:41:05.088236 14819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "582917d6410740598227c1cc709f27cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "582917d6410740598227c1cc709f27cd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46429 } } }
I20260808 17:41:05.088320 14819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:05.088500 14822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 582917d6410740598227c1cc709f27cd. Latest consensus state: current_term: 1 leader_uuid: "582917d6410740598227c1cc709f27cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "582917d6410740598227c1cc709f27cd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46429 } } }
I20260808 17:41:05.088588 14822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:05.089082 14829 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:05.089488 14829 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 17:41:05 dist-test-slave-bqcl krb5kdc[14677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:05.091264 14829 catalog_manager.cc:1347] Generated new cluster ID: 23ce72f351904d4987bd55bb107f8d22
I20260808 17:41:05.091321 14829 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:05.094722 14817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:05.083845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33000 (local address 127.9.187.254:46429)
0808 17:41:05.084019 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:05.084029 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:05.084059 (+ 30us) server_negotiation.cc:407] Connection header received
0808 17:41:05.084766 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:05.084774 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:05.084823 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:05.084931 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:05.085754 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:05.086796 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:05.087843 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:05.088419 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:05.088539 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:05.091260 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:05.091264 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:05.091265 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:05.091276 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:05.093115 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:05.093509 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:05.093511 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:05.093511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:05.093625 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:05.093828 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:05.093829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:05.093829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:05.094101 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:05.094280 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:05.094390 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 17:41:05.094513 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
I20260808 17:41:05.095523 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:41:05.112742 14817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:05.108773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33010 (local address 127.9.187.254:46429)
0808 17:41:05.108807 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:05.108809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:05.108951 (+ 142us) server_negotiation.cc:407] Connection header received
0808 17:41:05.109001 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:05.109003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:05.109014 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:05.109075 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:05.109436 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:05.110232 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:05.111205 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:05.111531 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:05.111604 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:05.112255 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:05.112257 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:05.112257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:05.112480 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:05.112500 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:05.112508 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:05.112563 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:05.112625 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 17:41:05.112649 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:41:05.114241 14829 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:05.114943 14829 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:05.121241 14829 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 582917d6410740598227c1cc709f27cd: Generated new TSK 0
I20260808 17:41:05.121419 14829 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:41:05.128742 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 14701
2026-08-08T17:41:05Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1438 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:05 dist-test-slave-bqcl krb5kdc[14863](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:05 dist-test-slave-bqcl krb5kdc[14863](info): set up 2 sockets
Aug 08 17:41:05 dist-test-slave-bqcl krb5kdc[14863](info): commencing operation
krb5kdc: starting...
W20260808 17:41:06.294461 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:06 dist-test-slave-bqcl krb5kdc[14863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:41:06.412710 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:44897
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:35769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:44897
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:06.493868 14893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:06.494069 14893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:06.494099 14893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:06.495247 14893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:06.495290 14893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:06.495311 14893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:06.495326 14893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:06.495340 14893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:06.496901 14893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:44897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:44897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:06.497148 14893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:06.497352 14893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:06.502345 14902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:06.502388 14901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:06.502379 14908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:06.502661 14893 server_base.cc:1034] running on GCE node
I20260808 17:41:06.502907 14893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:06.503187 14893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:06.504323 14893 hybrid_clock.cc:648] HybridClock initialized: now 1786210866504298 us; error 36 us; skew 500 ppm
Aug 08 17:41:06 dist-test-slave-bqcl krb5kdc[14863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210866, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:06.507057 14893 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:41:06.507452 14893 webserver.cc:460] Webserver started at http://127.9.187.254:40507/ using document root <none> and password file <none>
I20260808 17:41:06.507673 14893 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:06.507722 14893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:06.507841 14893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:06.508828 14893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "e4687a1d694a42daacdad805f1b8df63"
format_stamp: "Formatted at 2026-08-08 17:41:06 on dist-test-slave-bqcl"
server_key: "ac6b064c3c73157d274e570818a28ab1"
server_key_iv: "37dcb8af3a97866e9f30e2aa778a0ddf"
server_key_version: "encryptionkey@0"
I20260808 17:41:06.509168 14893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "e4687a1d694a42daacdad805f1b8df63"
format_stamp: "Formatted at 2026-08-08 17:41:06 on dist-test-slave-bqcl"
server_key: "ac6b064c3c73157d274e570818a28ab1"
server_key_iv: "37dcb8af3a97866e9f30e2aa778a0ddf"
server_key_version: "encryptionkey@0"
I20260808 17:41:06.510399 14893 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:41:06.511049 14919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:06.511201 14893 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:06.511286 14893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "e4687a1d694a42daacdad805f1b8df63"
format_stamp: "Formatted at 2026-08-08 17:41:06 on dist-test-slave-bqcl"
server_key: "ac6b064c3c73157d274e570818a28ab1"
server_key_iv: "37dcb8af3a97866e9f30e2aa778a0ddf"
server_key_version: "encryptionkey@0"
I20260808 17:41:06.511343 14893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:06.534847 14893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:06.536633 14893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:06.536779 14893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:06.540795 14893 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:44897
I20260808 17:41:06.540832 15000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:44897 every 8 connection(s)
I20260808 17:41:06.541189 14893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:06.542459 15001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:06.544746 15001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63: Bootstrap starting.
I20260808 17:41:06.545316 15001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:06.545552 15001 log.cc:824] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:06.546288 15001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63: No bootstrap required, opened a new log
I20260808 17:41:06.547341 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 14893
I20260808 17:41:06.547454 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:06.547626 9967 external_mini_cluster.cc:1428] Setting key 86412c6616593f570d647d223288a09b
I20260808 17:41:06.548192 15001 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4687a1d694a42daacdad805f1b8df63" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44897 } }
I20260808 17:41:06.548374 15001 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:06.548403 15001 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4687a1d694a42daacdad805f1b8df63, State: Initialized, Role: FOLLOWER
I20260808 17:41:06.548535 15001 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4687a1d694a42daacdad805f1b8df63" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44897 } }
I20260808 17:41:06.548609 15001 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:06.548630 15001 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:06.548676 15001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:06.549817 15001 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4687a1d694a42daacdad805f1b8df63" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44897 } }
I20260808 17:41:06.549913 15001 leader_election.cc:302] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4687a1d694a42daacdad805f1b8df63; no voters:
I20260808 17:41:06.550066 15001 leader_election.cc:288] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:06.550107 15008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:06.550251 15008 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [term 1 LEADER]: Becoming Leader. State: Replica: e4687a1d694a42daacdad805f1b8df63, State: Running, Role: LEADER
I20260808 17:41:06.550366 15001 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:06.550334 15008 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4687a1d694a42daacdad805f1b8df63" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44897 } }
I20260808 17:41:06.550706 15008 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4687a1d694a42daacdad805f1b8df63. Latest consensus state: current_term: 1 leader_uuid: "e4687a1d694a42daacdad805f1b8df63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4687a1d694a42daacdad805f1b8df63" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44897 } } }
I20260808 17:41:06.550787 15008 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:06.550711 15009 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4687a1d694a42daacdad805f1b8df63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4687a1d694a42daacdad805f1b8df63" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44897 } } }
I20260808 17:41:06.550832 15009 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:06.551642 15026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:06.552142 15026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:06.553710 15026 catalog_manager.cc:1347] Generated new cluster ID: de27a4f82625418ca74da6a1017462f4
I20260808 17:41:06.553766 15026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:41:06 dist-test-slave-bqcl krb5kdc[14863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:06.558842 15005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:06.548162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45170 (local address 127.9.187.254:44897)
0808 17:41:06.548347 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:06.548357 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:06.548400 (+ 43us) server_negotiation.cc:407] Connection header received
0808 17:41:06.548524 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:06.548530 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:06.548577 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:06.548716 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:06.549533 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:06.550811 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:06.551880 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:06.552449 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:06.552560 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:06.555284 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:06.555289 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:06.555289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:06.555301 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:06.557187 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:06.557591 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:06.557594 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:06.557594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:06.557719 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:06.557923 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:06.557923 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:06.557924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:06.558244 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:06.558401 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:06.558506 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 17:41:06.558639 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260808 17:41:06.564024 15026 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:06.564749 15026 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:06.576417 15026 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4687a1d694a42daacdad805f1b8df63: Generated new TSK 0
I20260808 17:41:06.576617 15026 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:41:06.608899 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44897
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:35769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:06.690214 15050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:06.690426 15050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:06.690459 15050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:06.691617 15050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:06.691659 15050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:06.691694 15050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:06.693178 15050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:06.693420 15050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:06.693642 15050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:06.698678 15064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:06.699023 15059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:06.703521 15061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:06.704171 15050 server_base.cc:1034] running on GCE node
I20260808 17:41:06.704389 15050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:06.704643 15050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:06.705776 15050 hybrid_clock.cc:648] HybridClock initialized: now 1786210866705735 us; error 55 us; skew 500 ppm
Aug 08 17:41:06 dist-test-slave-bqcl krb5kdc[14863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210866, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:06.710507 15050 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:41:06.710893 15050 webserver.cc:460] Webserver started at http://127.9.187.193:38307/ using document root <none> and password file <none>
I20260808 17:41:06.711100 15050 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:06.711141 15050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:06.711236 15050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:06.712256 15050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "1abefd67700d4a74999ae860ef64c7d5"
format_stamp: "Formatted at 2026-08-08 17:41:06 on dist-test-slave-bqcl"
server_key: "a7edc0bc8543adf1675778d393295b8c"
server_key_iv: "29f12f68c3172b3cf59129c9895c3732"
server_key_version: "encryptionkey@0"
I20260808 17:41:06.712558 15050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "1abefd67700d4a74999ae860ef64c7d5"
format_stamp: "Formatted at 2026-08-08 17:41:06 on dist-test-slave-bqcl"
server_key: "a7edc0bc8543adf1675778d393295b8c"
server_key_iv: "29f12f68c3172b3cf59129c9895c3732"
server_key_version: "encryptionkey@0"
I20260808 17:41:06.713769 15050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 17:41:06.714663 15078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:06.714807 15050 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:06.714895 15050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "1abefd67700d4a74999ae860ef64c7d5"
format_stamp: "Formatted at 2026-08-08 17:41:06 on dist-test-slave-bqcl"
server_key: "a7edc0bc8543adf1675778d393295b8c"
server_key_iv: "29f12f68c3172b3cf59129c9895c3732"
server_key_version: "encryptionkey@0"
I20260808 17:41:06.714968 15050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:06.729045 15050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:06.731153 15050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:06.731287 15050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:06.731487 15050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:06.731779 15050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:06.731812 15050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:06.731840 15050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:06.731864 15050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:06.737205 15050 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:37085
I20260808 17:41:06.737243 15275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:37085 every 8 connection(s)
I20260808 17:41:06.737535 15050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:41:06 dist-test-slave-bqcl krb5kdc[14863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210866, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:06.744194 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 15050
I20260808 17:41:06.744279 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:06.744443 9967 external_mini_cluster.cc:1428] Setting key 8dc7ea96af6987db4d7d52f9b90371a6
I20260808 17:41:06.745770 15005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:06.738175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:46629 (local address 127.9.187.254:44897)
0808 17:41:06.738226 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:06.738228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:06.738411 (+ 183us) server_negotiation.cc:407] Connection header received
0808 17:41:06.738906 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:06.738907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:06.738920 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:06.738967 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:06.739846 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:06.740338 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:06.741247 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:06.741428 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:06.741470 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:06.743345 (+ 1875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:06.743347 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:06.743347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:06.743354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:06.744504 (+ 1150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:06.744851 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:06.744851 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:06.744852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:06.744915 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:06.745178 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:06.745178 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:06.745179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:06.745301 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:06.745354 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:06.745632 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 17:41:06.745698 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:41:06.745985 15286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:06.738159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:44897 (local address 127.9.187.193:46629)
0808 17:41:06.738296 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:06.738332 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:06.738824 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:06.739024 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:06.739028 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:06.739573 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:06.739769 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:06.739774 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:06.740397 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:06.740398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:06.741189 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:06.741191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:06.741478 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:06.741479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:06.741571 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:06.741936 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:06.741943 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:06.743254 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:06.744571 (+ 1317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:06.744579 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:06.744581 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:06.744789 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:06.744978 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:06.744978 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:06.744979 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:06.745113 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:06.745361 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:06.745367 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:06.745512 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 17:41:06.745617 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 17:41:06.745774 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
I20260808 17:41:06.746457 15276 heartbeater.cc:347] Connected to a master server at 127.9.187.254:44897
I20260808 17:41:06.746543 15276 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:06.746714 15276 heartbeater.cc:511] Master 127.9.187.254:44897 requested a full tablet report, sending...
I20260808 17:41:06.747289 14947 ts_manager.cc:194] Registered new tserver with Master: 1abefd67700d4a74999ae860ef64c7d5 (127.9.187.193:37085)
I20260808 17:41:06.748117 14947 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:46629
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:41:06.768705 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44897
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:35769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:06.849022 15291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:06.849218 15291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:06.849239 15291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:06.850414 15291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:06.850458 15291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:06.850484 15291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:06.851995 15291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:06.852219 15291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:06.852427 15291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:06.857205 15309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:06.857249 15305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:06.857259 15304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:06.857384 15291 server_base.cc:1034] running on GCE node
I20260808 17:41:06.857599 15291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:06.857825 15291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:06.858969 15291 hybrid_clock.cc:648] HybridClock initialized: now 1786210866858957 us; error 27 us; skew 500 ppm
Aug 08 17:41:06 dist-test-slave-bqcl krb5kdc[14863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210866, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:06.861380 15291 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:41:06.861825 15291 webserver.cc:460] Webserver started at http://127.9.187.194:33399/ using document root <none> and password file <none>
I20260808 17:41:06.862021 15291 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:06.862072 15291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:06.862229 15291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:06.863261 15291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "2f0da79066054795b8dc5e7fc3fd1b9b"
format_stamp: "Formatted at 2026-08-08 17:41:06 on dist-test-slave-bqcl"
server_key: "2aba2911fd1ddac6e3bbc38560396325"
server_key_iv: "bcc3c4a0fb8a0d1ac3d873d50091f502"
server_key_version: "encryptionkey@0"
I20260808 17:41:06.863595 15291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "2f0da79066054795b8dc5e7fc3fd1b9b"
format_stamp: "Formatted at 2026-08-08 17:41:06 on dist-test-slave-bqcl"
server_key: "2aba2911fd1ddac6e3bbc38560396325"
server_key_iv: "bcc3c4a0fb8a0d1ac3d873d50091f502"
server_key_version: "encryptionkey@0"
I20260808 17:41:06.864802 15291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:06.865420 15321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:06.865599 15291 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:06.865681 15291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "2f0da79066054795b8dc5e7fc3fd1b9b"
format_stamp: "Formatted at 2026-08-08 17:41:06 on dist-test-slave-bqcl"
server_key: "2aba2911fd1ddac6e3bbc38560396325"
server_key_iv: "bcc3c4a0fb8a0d1ac3d873d50091f502"
server_key_version: "encryptionkey@0"
I20260808 17:41:06.865739 15291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:06.878954 15291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:06.880913 15291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:06.881038 15291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:06.881232 15291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:06.881502 15291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:06.881536 15291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:06.881563 15291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:06.881597 15291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:06.886898 15291 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:41523
I20260808 17:41:06.886955 15512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:41523 every 8 connection(s)
I20260808 17:41:06.887226 15291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:41:06 dist-test-slave-bqcl krb5kdc[14863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210866, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:06.893478 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 15291
I20260808 17:41:06.893581 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:06.893807 9967 external_mini_cluster.cc:1428] Setting key 0090033bd737f0ecc991e9af4a13490f
I20260808 17:41:06.895774 15005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:06.887893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:46663 (local address 127.9.187.254:44897)
0808 17:41:06.887960 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:06.887962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:06.888101 (+ 139us) server_negotiation.cc:407] Connection header received
0808 17:41:06.888535 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:06.888536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:06.888545 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:06.888597 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:06.889412 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:06.889910 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:06.890900 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:06.891089 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:06.891136 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:06.893087 (+ 1951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:06.893089 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:06.893089 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:06.893097 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:06.894508 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:06.894880 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:06.894881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:06.894882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:06.894948 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:06.895200 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:06.895201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:06.895201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:06.895338 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:06.895398 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:06.895605 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 17:41:06.895685 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 17:41:06.895866 15518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:06.887844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:44897 (local address 127.9.187.194:46663)
0808 17:41:06.887986 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:06.888025 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:06.888463 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:06.888649 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:06.888652 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:06.889172 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:06.889347 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:06.889352 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:06.889986 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:06.889987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:06.890831 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:06.890834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:06.891142 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:06.891142 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:06.891232 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:06.891661 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:06.891669 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:06.892994 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:06.894598 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:06.894605 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:06.894607 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:06.894815 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:06.895010 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:06.895011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:06.895011 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:06.895139 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:06.895397 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:06.895400 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:06.895503 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 17:41:06.895592 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 17:41:06.895706 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":76,"threads_started":1}
I20260808 17:41:06.896366 15514 heartbeater.cc:347] Connected to a master server at 127.9.187.254:44897
I20260808 17:41:06.896456 15514 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:06.896624 15514 heartbeater.cc:511] Master 127.9.187.254:44897 requested a full tablet report, sending...
I20260808 17:41:06.896976 14947 ts_manager.cc:194] Registered new tserver with Master: 2f0da79066054795b8dc5e7fc3fd1b9b (127.9.187.194:41523)
I20260808 17:41:06.897473 14947 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:46663
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:41:06.918579 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44897
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:35769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:06.999094 15522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:06.999320 15522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:06.999351 15522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:07.000485 15522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:07.000527 15522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:07.000561 15522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:07.002038 15522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:07.002310 15522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:07.002521 15522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:07.007325 15533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:07.007345 15530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:07.007325 15529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:07.007706 15522 server_base.cc:1034] running on GCE node
I20260808 17:41:07.007900 15522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:07.008141 15522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:07.009281 15522 hybrid_clock.cc:648] HybridClock initialized: now 1786210867009265 us; error 27 us; skew 500 ppm
Aug 08 17:41:07 dist-test-slave-bqcl krb5kdc[14863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210867, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:07.011786 15522 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:41:07.012190 15522 webserver.cc:460] Webserver started at http://127.9.187.195:35785/ using document root <none> and password file <none>
I20260808 17:41:07.012383 15522 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:07.012431 15522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:07.012564 15522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:07.013585 15522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "57b52afccbfd4ead8cf961af464fea4e"
format_stamp: "Formatted at 2026-08-08 17:41:07 on dist-test-slave-bqcl"
server_key: "273c75f61f30f5737c6a961c8413cf6c"
server_key_iv: "f95800b1d487ef6a10579f7b94994b33"
server_key_version: "encryptionkey@0"
I20260808 17:41:07.013914 15522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "57b52afccbfd4ead8cf961af464fea4e"
format_stamp: "Formatted at 2026-08-08 17:41:07 on dist-test-slave-bqcl"
server_key: "273c75f61f30f5737c6a961c8413cf6c"
server_key_iv: "f95800b1d487ef6a10579f7b94994b33"
server_key_version: "encryptionkey@0"
I20260808 17:41:07.015199 15522 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:07.015862 15545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:07.016016 15522 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:07.016105 15522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "57b52afccbfd4ead8cf961af464fea4e"
format_stamp: "Formatted at 2026-08-08 17:41:07 on dist-test-slave-bqcl"
server_key: "273c75f61f30f5737c6a961c8413cf6c"
server_key_iv: "f95800b1d487ef6a10579f7b94994b33"
server_key_version: "encryptionkey@0"
I20260808 17:41:07.016170 15522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:07.026568 15522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:07.028574 15522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:07.028703 15522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:07.028905 15522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:07.029181 15522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:07.029214 15522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:07.029242 15522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:07.029266 15522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:07.034795 15522 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:43335
I20260808 17:41:07.034853 15730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:43335 every 8 connection(s)
I20260808 17:41:07.035148 15522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:41:07 dist-test-slave-bqcl krb5kdc[14863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210867, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:07.043421 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 15522
I20260808 17:41:07.043540 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:07.043749 9967 external_mini_cluster.cc:1428] Setting key 0d165fdc351adf595640bc36ae39e546
I20260808 17:41:07.044986 15005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:07.035810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:39517 (local address 127.9.187.254:44897)
0808 17:41:07.035869 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:07.035871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:07.036061 (+ 190us) server_negotiation.cc:407] Connection header received
0808 17:41:07.036567 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:07.036569 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:07.036587 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:07.036661 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:07.037561 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:07.038118 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:07.039221 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:07.039441 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:07.039516 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:07.042164 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:07.042165 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:07.042166 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:07.042174 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:07.043608 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:07.044031 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:07.044033 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:07.044033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:07.044099 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:07.044376 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:07.044377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:07.044377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:07.044499 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:07.044560 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:07.044851 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 17:41:07.044921 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:41:07.045171 15734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:07.035757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:44897 (local address 127.9.187.195:39517)
0808 17:41:07.035935 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:07.035977 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:07.036451 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:07.036721 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:07.036725 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:07.037288 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:07.037472 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:07.037477 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:07.038243 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:07.038244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:07.039100 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:07.039103 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:07.039568 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:07.039570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:07.039719 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:07.040286 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:07.040294 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:07.042013 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:07.043685 (+ 1672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:07.043691 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:07.043693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:07.043949 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:07.044164 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:07.044165 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:07.044165 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:07.044311 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:07.044563 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:07.044569 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:07.044726 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 17:41:07.044826 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 17:41:07.044953 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":92,"threads_started":1}
I20260808 17:41:07.045640 15732 heartbeater.cc:347] Connected to a master server at 127.9.187.254:44897
I20260808 17:41:07.045737 15732 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:07.045914 15732 heartbeater.cc:511] Master 127.9.187.254:44897 requested a full tablet report, sending...
I20260808 17:41:07.046294 14947 ts_manager.cc:194] Registered new tserver with Master: 57b52afccbfd4ead8cf961af464fea4e (127.9.187.195:43335)
I20260808 17:41:07.046655 14947 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:39517
I20260808 17:41:07.055367 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 17:41:07 dist-test-slave-bqcl krb5kdc[14863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210867, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 17:41:07 dist-test-slave-bqcl krb5kdc[14863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210867, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:07.080092 15005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:07.073125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45186 (local address 127.9.187.254:44897)
0808 17:41:07.073213 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:07.073215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:07.073301 (+ 86us) server_negotiation.cc:407] Connection header received
0808 17:41:07.073369 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:07.073370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:07.073382 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:07.073430 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:07.074009 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:07.074550 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:07.075282 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:07.075479 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:07.075537 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:07.077711 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:07.077712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:07.077712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:07.077720 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:07.079038 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:07.079340 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:07.079341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:07.079341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:07.079395 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:07.079565 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:07.079566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:07.079566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:07.079712 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:07.079805 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:07.079910 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 17:41:07.079990 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 17:41:07.080325 14947 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45186
I20260808 17:41:07.080715 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 15050
I20260808 17:41:07.114480 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 15291
I20260808 17:41:07.138944 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 15522
I20260808 17:41:07.154337 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 14893
2026-08-08T17:41:07Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2020 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:07 dist-test-slave-bqcl krb5kdc[15745](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:07 dist-test-slave-bqcl krb5kdc[15745](info): set up 2 sockets
Aug 08 17:41:07 dist-test-slave-bqcl krb5kdc[15745](info): commencing operation
krb5kdc: starting...
W20260808 17:41:08.308624 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:08 dist-test-slave-bqcl krb5kdc[15745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:41:08.423322 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33087
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:33087
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:08.517627 15772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:08.517835 15772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:08.517858 15772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:08.519038 15772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:08.519080 15772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:08.519093 15772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:08.519105 15772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:08.519129 15772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:08.520586 15772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:33087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:08.520810 15772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:08.521015 15772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:08.525529 15783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:08.525573 15781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:08.525573 15787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:08.525590 15772 server_base.cc:1034] running on GCE node
I20260808 17:41:08.525992 15772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:08.526292 15772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:08.527447 15772 hybrid_clock.cc:648] HybridClock initialized: now 1786210868527426 us; error 35 us; skew 500 ppm
Aug 08 17:41:08 dist-test-slave-bqcl krb5kdc[15745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210868, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:08.533190 15772 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:41:08.533660 15772 webserver.cc:460] Webserver started at http://127.9.187.254:46513/ using document root <none> and password file <none>
I20260808 17:41:08.533856 15772 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:08.533903 15772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:08.534026 15772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:08.535115 15772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "1ac37a6e11ff4c85941ecb0e04e4ee29"
format_stamp: "Formatted at 2026-08-08 17:41:08 on dist-test-slave-bqcl"
server_key: "dbe503f99d2f70b381c4561aa0829676"
server_key_iv: "a02a2550e35e171ab84d8c4b023a3f32"
server_key_version: "encryptionkey@0"
I20260808 17:41:08.535463 15772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "1ac37a6e11ff4c85941ecb0e04e4ee29"
format_stamp: "Formatted at 2026-08-08 17:41:08 on dist-test-slave-bqcl"
server_key: "dbe503f99d2f70b381c4561aa0829676"
server_key_iv: "a02a2550e35e171ab84d8c4b023a3f32"
server_key_version: "encryptionkey@0"
I20260808 17:41:08.536679 15772 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:41:08.537355 15802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:08.537514 15772 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:08.537631 15772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "1ac37a6e11ff4c85941ecb0e04e4ee29"
format_stamp: "Formatted at 2026-08-08 17:41:08 on dist-test-slave-bqcl"
server_key: "dbe503f99d2f70b381c4561aa0829676"
server_key_iv: "a02a2550e35e171ab84d8c4b023a3f32"
server_key_version: "encryptionkey@0"
I20260808 17:41:08.537698 15772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:08.549459 15772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:08.551101 15772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:08.551232 15772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:08.555160 15772 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:33087
I20260808 17:41:08.555192 15878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:33087 every 8 connection(s)
I20260808 17:41:08.555725 15772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:08.556380 15879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:08.558625 15879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29: Bootstrap starting.
I20260808 17:41:08.559204 15879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:08.559482 15879 log.cc:824] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:08.560107 15879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29: No bootstrap required, opened a new log
I20260808 17:41:08.561866 15879 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac37a6e11ff4c85941ecb0e04e4ee29" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33087 } }
I20260808 17:41:08.562004 15879 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:08.562032 15879 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ac37a6e11ff4c85941ecb0e04e4ee29, State: Initialized, Role: FOLLOWER
I20260808 17:41:08.562180 15879 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac37a6e11ff4c85941ecb0e04e4ee29" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33087 } }
I20260808 17:41:08.562261 15879 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:08.562300 15879 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:08.562348 15879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:08.562439 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 15772
I20260808 17:41:08.562549 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:08.562736 9967 external_mini_cluster.cc:1428] Setting key f1cf29d3b7055a99abee7c308aa8bc5c
I20260808 17:41:08.563694 15879 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac37a6e11ff4c85941ecb0e04e4ee29" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33087 } }
I20260808 17:41:08.563862 15879 leader_election.cc:302] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ac37a6e11ff4c85941ecb0e04e4ee29; no voters:
I20260808 17:41:08.564043 15879 leader_election.cc:288] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:08.564117 15889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:08.564399 15879 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:08.564402 15889 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [term 1 LEADER]: Becoming Leader. State: Replica: 1ac37a6e11ff4c85941ecb0e04e4ee29, State: Running, Role: LEADER
I20260808 17:41:08.564739 15889 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac37a6e11ff4c85941ecb0e04e4ee29" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33087 } }
I20260808 17:41:08.565168 15892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ac37a6e11ff4c85941ecb0e04e4ee29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac37a6e11ff4c85941ecb0e04e4ee29" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33087 } } }
I20260808 17:41:08.565270 15892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:08.565459 15893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ac37a6e11ff4c85941ecb0e04e4ee29. Latest consensus state: current_term: 1 leader_uuid: "1ac37a6e11ff4c85941ecb0e04e4ee29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac37a6e11ff4c85941ecb0e04e4ee29" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33087 } } }
I20260808 17:41:08.565546 15893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29 [sys.catalog]: This master's current role is: LEADER
W20260808 17:41:08.566277 15911 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:41:08.566373 15911 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:41:08.566457 15902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:08.566607 15902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:08.568043 15902 catalog_manager.cc:1347] Generated new cluster ID: c7227932a63d4597957e07fe6adf975a
I20260808 17:41:08.568096 15902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:41:08 dist-test-slave-bqcl krb5kdc[15745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:08.574263 15888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:08.563228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57524 (local address 127.9.187.254:33087)
0808 17:41:08.563416 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:08.563426 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:08.563459 (+ 33us) server_negotiation.cc:407] Connection header received
0808 17:41:08.563575 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:08.563581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:08.563635 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:08.563770 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:08.564651 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:08.566112 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:08.566862 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:08.567369 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:08.567475 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:08.570149 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:08.570153 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:08.570154 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:08.570166 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:08.572661 (+ 2495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:08.573025 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:08.573029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:08.573029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:08.573157 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:08.573330 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:08.573331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:08.573332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:08.573638 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:08.573804 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:08.573873 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 17:41:08.574008 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":94,"threads_started":1}
I20260808 17:41:08.591112 15902 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:08.591619 15902 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:08.599579 15902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ac37a6e11ff4c85941ecb0e04e4ee29: Generated new TSK 0
I20260808 17:41:08.599747 15902 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:41:08.624832 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33087
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:08.708652 15919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:08.708850 15919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:08.708871 15919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:08.710038 15919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:08.710088 15919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:08.710114 15919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:08.711635 15919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:08.711856 15919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:08.712078 15919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:08.717036 15928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:08.717042 15927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:08.717123 15919 server_base.cc:1034] running on GCE node
W20260808 17:41:08.717240 15932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:08.717469 15919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:08.717726 15919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:08.718878 15919 hybrid_clock.cc:648] HybridClock initialized: now 1786210868718855 us; error 34 us; skew 500 ppm
Aug 08 17:41:08 dist-test-slave-bqcl krb5kdc[15745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210868, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:08.721338 15919 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:41:08.721757 15919 webserver.cc:460] Webserver started at http://127.9.187.193:36115/ using document root <none> and password file <none>
I20260808 17:41:08.721940 15919 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:08.721979 15919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:08.722087 15919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:08.723068 15919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "824d8855194442979783d47360044304"
format_stamp: "Formatted at 2026-08-08 17:41:08 on dist-test-slave-bqcl"
server_key: "5846fa41d512961a6e8d61083ff2a7aa"
server_key_iv: "b15d35eafbdabbc106d4494800ab3d3e"
server_key_version: "encryptionkey@0"
I20260808 17:41:08.723356 15919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "824d8855194442979783d47360044304"
format_stamp: "Formatted at 2026-08-08 17:41:08 on dist-test-slave-bqcl"
server_key: "5846fa41d512961a6e8d61083ff2a7aa"
server_key_iv: "b15d35eafbdabbc106d4494800ab3d3e"
server_key_version: "encryptionkey@0"
I20260808 17:41:08.724506 15919 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:08.725198 15948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:08.725375 15919 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:08.725451 15919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "824d8855194442979783d47360044304"
format_stamp: "Formatted at 2026-08-08 17:41:08 on dist-test-slave-bqcl"
server_key: "5846fa41d512961a6e8d61083ff2a7aa"
server_key_iv: "b15d35eafbdabbc106d4494800ab3d3e"
server_key_version: "encryptionkey@0"
I20260808 17:41:08.725520 15919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:08.749253 15919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:08.751055 15919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:08.751183 15919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:08.751398 15919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:08.751694 15919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:08.751729 15919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:08.751749 15919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:08.751773 15919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:08.757030 15919 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:40055
I20260808 17:41:08.757088 16146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:40055 every 8 connection(s)
I20260808 17:41:08.757385 15919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:41:08.759884 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 15919
I20260808 17:41:08.759987 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:08.760175 9967 external_mini_cluster.cc:1428] Setting key 726cd06bff38bc3044a74b2215d88d80
Aug 08 17:41:08 dist-test-slave-bqcl krb5kdc[15745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210868, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:08.767167 15888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:08.758066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:59227 (local address 127.9.187.254:33087)
0808 17:41:08.758153 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:08.758156 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:08.758349 (+ 193us) server_negotiation.cc:407] Connection header received
0808 17:41:08.759286 (+ 937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:08.759288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:08.759304 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:08.759356 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:08.760009 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:08.760678 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:08.761704 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:08.761973 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:08.762053 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:08.764329 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:08.764330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:08.764330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:08.764338 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:08.765822 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:08.766218 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:08.766220 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:08.766220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:08.766287 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:08.766527 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:08.766528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:08.766529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:08.766671 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:08.766732 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:08.766978 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 17:41:08.767071 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:41:08.767204 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:08.758028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33087 (local address 127.9.187.193:59227)
0808 17:41:08.758225 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:08.758267 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:08.759170 (+ 903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:08.759430 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:08.759434 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:08.759696 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:08.759893 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:08.759898 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:08.760792 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:08.760793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:08.761619 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:08.761621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:08.762045 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:08.762046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:08.762157 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:08.762626 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:08.762637 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:08.764235 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:08.765896 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:08.765903 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:08.765905 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:08.766117 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:08.766350 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:08.766350 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:08.766351 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:08.766456 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:08.766730 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:08.766740 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:08.766850 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 17:41:08.766923 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 17:41:08.767042 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":101,"threads_started":1}
I20260808 17:41:08.767680 16151 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33087
I20260808 17:41:08.767782 16151 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:08.767958 16151 heartbeater.cc:511] Master 127.9.187.254:33087 requested a full tablet report, sending...
I20260808 17:41:08.768498 15829 ts_manager.cc:194] Registered new tserver with Master: 824d8855194442979783d47360044304 (127.9.187.193:40055)
I20260808 17:41:08.769419 15829 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:59227
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:41:08.788350 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33087
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:08.868743 16161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:08.868938 16161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:08.868969 16161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:08.870072 16161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:08.870148 16161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:08.870189 16161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:08.871685 16161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:08.871913 16161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:08.872123 16161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:08.876961 16168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:08.877025 16171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:08.876972 16169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:08.877198 16161 server_base.cc:1034] running on GCE node
I20260808 17:41:08.877427 16161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:08.877677 16161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:08.878819 16161 hybrid_clock.cc:648] HybridClock initialized: now 1786210868878801 us; error 28 us; skew 500 ppm
Aug 08 17:41:08 dist-test-slave-bqcl krb5kdc[15745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210868, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:08.881278 16161 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:41:08.881701 16161 webserver.cc:460] Webserver started at http://127.9.187.194:37935/ using document root <none> and password file <none>
I20260808 17:41:08.881897 16161 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:08.881943 16161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:08.882069 16161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:08.883102 16161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "12845dcd92fe4312b1b4e296e1fc07ac"
format_stamp: "Formatted at 2026-08-08 17:41:08 on dist-test-slave-bqcl"
server_key: "97bfbdd49b70df2b0be3263c97382e81"
server_key_iv: "136f811d5a95acb3389c7c957514a744"
server_key_version: "encryptionkey@0"
I20260808 17:41:08.883423 16161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "12845dcd92fe4312b1b4e296e1fc07ac"
format_stamp: "Formatted at 2026-08-08 17:41:08 on dist-test-slave-bqcl"
server_key: "97bfbdd49b70df2b0be3263c97382e81"
server_key_iv: "136f811d5a95acb3389c7c957514a744"
server_key_version: "encryptionkey@0"
I20260808 17:41:08.884580 16161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:08.885273 16187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:08.885425 16161 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:08.885509 16161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "12845dcd92fe4312b1b4e296e1fc07ac"
format_stamp: "Formatted at 2026-08-08 17:41:08 on dist-test-slave-bqcl"
server_key: "97bfbdd49b70df2b0be3263c97382e81"
server_key_iv: "136f811d5a95acb3389c7c957514a744"
server_key_version: "encryptionkey@0"
I20260808 17:41:08.885567 16161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:08.908401 16161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:08.910692 16161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:08.910841 16161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:08.911051 16161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:08.911345 16161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:08.911379 16161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:08.911410 16161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:08.911434 16161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:08.916792 16161 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:38565
I20260808 17:41:08.916848 16390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:38565 every 8 connection(s)
I20260808 17:41:08.917132 16161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:41:08 dist-test-slave-bqcl krb5kdc[15745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210868, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:08.923375 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 16161
I20260808 17:41:08.923476 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:08.923662 9967 external_mini_cluster.cc:1428] Setting key bd9597feb15af50121c90c16bd1204ab
I20260808 17:41:08.925850 15888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:08.917774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:51023 (local address 127.9.187.254:33087)
0808 17:41:08.917833 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:08.917836 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:08.918012 (+ 176us) server_negotiation.cc:407] Connection header received
0808 17:41:08.918954 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:08.918955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:08.918965 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:08.919008 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:08.919576 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:08.920081 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:08.920984 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:08.921160 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:08.921204 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:08.923097 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:08.923098 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:08.923099 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:08.923106 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:08.924518 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:08.924876 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:08.924877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:08.924877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:08.924933 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:08.925165 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:08.925166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:08.925166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:08.925288 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:08.925344 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:08.925679 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 17:41:08.925760 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:41:08.926020 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:08.917732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33087 (local address 127.9.187.194:51023)
0808 17:41:08.917894 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:08.917935 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:08.918848 (+ 913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:08.919075 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:08.919078 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:08.919330 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:08.919513 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:08.919517 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:08.920148 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:08.920148 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:08.920924 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:08.920926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:08.921213 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:08.921214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:08.921311 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:08.921686 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:08.921694 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:08.923006 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:08.924589 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:08.924596 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:08.924598 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:08.924808 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:08.924992 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:08.924993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:08.924993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:08.925098 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:08.925345 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:08.925352 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:08.925506 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 17:41:08.925637 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 17:41:08.925811 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
I20260808 17:41:08.926471 16392 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33087
I20260808 17:41:08.926574 16392 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:08.926756 16392 heartbeater.cc:511] Master 127.9.187.254:33087 requested a full tablet report, sending...
I20260808 17:41:08.927111 15829 ts_manager.cc:194] Registered new tserver with Master: 12845dcd92fe4312b1b4e296e1fc07ac (127.9.187.194:38565)
I20260808 17:41:08.927446 15829 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:51023
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:41:08.949095 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33087
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:09.028833 16398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:09.029033 16398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:09.029063 16398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:09.030210 16398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:09.030251 16398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:09.030284 16398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:09.031718 16398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:09.031946 16398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:09.032151 16398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:09.036864 16418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:09.036907 16398 server_base.cc:1034] running on GCE node
W20260808 17:41:09.036872 16410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:09.036882 16407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:09.037273 16398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:09.037478 16398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:09.038605 16398 hybrid_clock.cc:648] HybridClock initialized: now 1786210869038593 us; error 28 us; skew 500 ppm
Aug 08 17:41:09 dist-test-slave-bqcl krb5kdc[15745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210869, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:09.040961 16398 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:41:09.041366 16398 webserver.cc:460] Webserver started at http://127.9.187.195:40691/ using document root <none> and password file <none>
I20260808 17:41:09.041561 16398 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:09.041607 16398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:09.041741 16398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:09.042826 16398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "701fef7f1b4f4ec0bcae7c81b8e9b8ba"
format_stamp: "Formatted at 2026-08-08 17:41:09 on dist-test-slave-bqcl"
server_key: "d395a06a97b43333e79ad9ac5d8d68af"
server_key_iv: "751d134369e9922d7982ba143f890efd"
server_key_version: "encryptionkey@0"
I20260808 17:41:09.043176 16398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "701fef7f1b4f4ec0bcae7c81b8e9b8ba"
format_stamp: "Formatted at 2026-08-08 17:41:09 on dist-test-slave-bqcl"
server_key: "d395a06a97b43333e79ad9ac5d8d68af"
server_key_iv: "751d134369e9922d7982ba143f890efd"
server_key_version: "encryptionkey@0"
I20260808 17:41:09.044376 16398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:09.045030 16432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:09.045174 16398 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:09.045266 16398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "701fef7f1b4f4ec0bcae7c81b8e9b8ba"
format_stamp: "Formatted at 2026-08-08 17:41:09 on dist-test-slave-bqcl"
server_key: "d395a06a97b43333e79ad9ac5d8d68af"
server_key_iv: "751d134369e9922d7982ba143f890efd"
server_key_version: "encryptionkey@0"
I20260808 17:41:09.045333 16398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:09.064657 16398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:09.066881 16398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:09.067024 16398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:09.067248 16398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:09.067557 16398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:09.067592 16398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:09.067621 16398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:09.067646 16398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:09.073222 16398 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:36993
I20260808 17:41:09.073285 16632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:36993 every 8 connection(s)
I20260808 17:41:09.073601 16398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:41:09 dist-test-slave-bqcl krb5kdc[15745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210869, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:09.082394 15888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:09.074352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:36767 (local address 127.9.187.254:33087)
0808 17:41:09.074405 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:09.074407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:09.074603 (+ 196us) server_negotiation.cc:407] Connection header received
0808 17:41:09.075533 (+ 930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:09.075535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:09.075549 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:09.075601 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:09.076203 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:09.076706 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:09.077780 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:09.077985 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:09.078042 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:09.080064 (+ 2022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:09.080065 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:09.080065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:09.080077 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:09.081158 (+ 1081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:09.081508 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:09.081508 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:09.081509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:09.081555 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:09.081745 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:09.081745 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:09.081745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:09.081839 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:09.081886 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:09.082247 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 17:41:09.082327 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:41:09.082504 16636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:09.074337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33087 (local address 127.9.187.195:36767)
0808 17:41:09.074485 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:09.074523 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:09.075425 (+ 902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:09.075673 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:09.075677 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:09.075928 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:09.076112 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:09.076116 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:09.076798 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:09.076799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:09.077689 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:09.077692 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:09.078055 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:09.078055 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:09.078219 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:09.078648 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:09.078655 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:09.079968 (+ 1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:09.081233 (+ 1265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:09.081239 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:09.081240 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:09.081451 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:09.081598 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:09.081599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:09.081599 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:09.081694 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:09.081928 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:09.081934 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:09.082059 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 17:41:09.082191 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 17:41:09.082326 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
I20260808 17:41:09.082959 16633 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33087
I20260808 17:41:09.083045 16633 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:09.083190 16633 heartbeater.cc:511] Master 127.9.187.254:33087 requested a full tablet report, sending...
I20260808 17:41:09.083505 15829 ts_manager.cc:194] Registered new tserver with Master: 701fef7f1b4f4ec0bcae7c81b8e9b8ba (127.9.187.195:36993)
I20260808 17:41:09.083675 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 16398
I20260808 17:41:09.083751 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:09.083835 15829 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:36767
I20260808 17:41:09.083941 9967 external_mini_cluster.cc:1428] Setting key f9bf8a40bd9e1919cdb0f38677a74285
I20260808 17:41:09.084771 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 17:41:09 dist-test-slave-bqcl krb5kdc[15745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 17:41:09 dist-test-slave-bqcl krb5kdc[15745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.193@KRBTEST.COM
I20260808 17:41:09.108366 16644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:09.101198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44642 (local address 127.9.187.193:40055)
0808 17:41:09.101356 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:09.101362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:09.101373 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:41:09.101401 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:09.101403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:09.101418 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:09.101487 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:09.102036 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:09.102876 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:09.103582 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:09.103920 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:09.103973 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:09.106078 (+ 2105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:09.106086 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:09.106086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:09.106092 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:09.107394 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:09.107688 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:09.107691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:09.107691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:09.107756 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:09.107960 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:09.107961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:09.107961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:09.108080 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:09.108191 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:09.108224 (+ 33us) server_negotiation.cc:299] Negotiation successful
0808 17:41:09.108279 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
Aug 08 17:41:09 dist-test-slave-bqcl krb5kdc[15745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:09.115893 15888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:09.109756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57534 (local address 127.9.187.254:33087)
0808 17:41:09.109798 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:09.109800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:09.109808 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:09.109844 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:09.109845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:09.109853 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:09.109885 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:09.110363 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:09.110851 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:09.111488 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:09.111675 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:09.111723 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:09.113721 (+ 1998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:09.113723 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:09.113723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:09.113738 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:09.115007 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:09.115307 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:09.115308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:09.115308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:09.115357 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:09.115484 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:09.115484 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:09.115485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:09.115614 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:09.115684 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:09.115769 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 17:41:09.115827 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 17:41:09.116114 15829 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57534
I20260808 17:41:09.116434 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 15919
I20260808 17:41:09.126678 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 16161
I20260808 17:41:09.141436 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 16398
I20260808 17:41:09.165946 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 15772
2026-08-08T17:41:09Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2010 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:09 dist-test-slave-bqcl krb5kdc[16654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:09 dist-test-slave-bqcl krb5kdc[16654](info): set up 2 sockets
Aug 08 17:41:09 dist-test-slave-bqcl krb5kdc[16654](info): commencing operation
krb5kdc: starting...
W20260808 17:41:10.315101 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:10 dist-test-slave-bqcl krb5kdc[16654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:41:10.430914 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33405
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:33405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:10.511297 16688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:10.511514 16688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:10.511547 16688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:10.512691 16688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:10.512738 16688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:10.512759 16688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:10.512774 16688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:10.512790 16688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:10.514333 16688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:33405
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:10.514581 16688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:10.514793 16688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:10.519366 16701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:10.519395 16696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:10.519379 16698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:10.519646 16688 server_base.cc:1034] running on GCE node
I20260808 17:41:10.519897 16688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:10.520196 16688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:10.521350 16688 hybrid_clock.cc:648] HybridClock initialized: now 1786210870521336 us; error 32 us; skew 500 ppm
Aug 08 17:41:10 dist-test-slave-bqcl krb5kdc[16654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210870, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:10.523804 16688 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:41:10.524102 16688 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:10.524154 16688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:10.524287 16688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:10.525315 16688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "0cc87691661c47a7ae9950df6071ad71"
format_stamp: "Formatted at 2026-08-08 17:41:10 on dist-test-slave-bqcl"
server_key: "4d6168fb01794e94c585166d3024b9d8"
server_key_iv: "70006a7df71096e3e03274a75330f190"
server_key_version: "encryptionkey@0"
I20260808 17:41:10.525655 16688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "0cc87691661c47a7ae9950df6071ad71"
format_stamp: "Formatted at 2026-08-08 17:41:10 on dist-test-slave-bqcl"
server_key: "4d6168fb01794e94c585166d3024b9d8"
server_key_iv: "70006a7df71096e3e03274a75330f190"
server_key_version: "encryptionkey@0"
I20260808 17:41:10.526906 16688 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 17:41:10.527539 16712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:10.527686 16688 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:10.527772 16688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "0cc87691661c47a7ae9950df6071ad71"
format_stamp: "Formatted at 2026-08-08 17:41:10 on dist-test-slave-bqcl"
server_key: "4d6168fb01794e94c585166d3024b9d8"
server_key_iv: "70006a7df71096e3e03274a75330f190"
server_key_version: "encryptionkey@0"
I20260808 17:41:10.527829 16688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:10.536625 16688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:10.538426 16688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:10.538565 16688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:10.542421 16688 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:33405
I20260808 17:41:10.542445 16800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:33405 every 8 connection(s)
I20260808 17:41:10.542714 16688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:10.543782 16801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:10.545284 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 16688
I20260808 17:41:10.545400 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:10.545610 9967 external_mini_cluster.cc:1428] Setting key 674b42d12b5364beefaf3c471a0e93f2
I20260808 17:41:10.546484 16801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71: Bootstrap starting.
I20260808 17:41:10.547122 16801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:10.547468 16801 log.cc:824] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:10.548179 16801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71: No bootstrap required, opened a new log
I20260808 17:41:10.549883 16801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cc87691661c47a7ae9950df6071ad71" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33405 } }
I20260808 17:41:10.550029 16801 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:10.550065 16801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cc87691661c47a7ae9950df6071ad71, State: Initialized, Role: FOLLOWER
I20260808 17:41:10.550218 16801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cc87691661c47a7ae9950df6071ad71" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33405 } }
I20260808 17:41:10.550302 16801 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:10.550338 16801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:10.550381 16801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:10.550926 16801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cc87691661c47a7ae9950df6071ad71" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33405 } }
I20260808 17:41:10.551028 16801 leader_election.cc:302] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0cc87691661c47a7ae9950df6071ad71; no voters:
I20260808 17:41:10.551187 16801 leader_election.cc:288] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:10.551232 16810 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:10.551406 16810 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [term 1 LEADER]: Becoming Leader. State: Replica: 0cc87691661c47a7ae9950df6071ad71, State: Running, Role: LEADER
I20260808 17:41:10.551451 16801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:10.551569 16810 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cc87691661c47a7ae9950df6071ad71" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33405 } }
Aug 08 17:41:10 dist-test-slave-bqcl krb5kdc[16654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:10.551934 16811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0cc87691661c47a7ae9950df6071ad71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cc87691661c47a7ae9950df6071ad71" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33405 } } }
I20260808 17:41:10.552009 16811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:10.552268 16812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cc87691661c47a7ae9950df6071ad71. Latest consensus state: current_term: 1 leader_uuid: "0cc87691661c47a7ae9950df6071ad71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cc87691661c47a7ae9950df6071ad71" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33405 } } }
I20260808 17:41:10.552386 16812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:10.552569 16819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:10.553050 16819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:10.554632 16819 catalog_manager.cc:1347] Generated new cluster ID: a953b42c1eff487b8439e4391080217e
I20260808 17:41:10.554687 16819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:10.557006 16805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:10.546177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38982 (local address 127.9.187.254:33405)
0808 17:41:10.546356 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:10.546366 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:10.546393 (+ 27us) server_negotiation.cc:407] Connection header received
0808 17:41:10.546888 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:10.546895 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:10.546956 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:10.547074 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:10.547867 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:10.548782 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:10.549514 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:10.549916 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:10.550012 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:10.552481 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:10.552486 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:10.552486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:10.552498 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:10.555445 (+ 2947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:10.555854 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:10.555857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:10.555857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:10.555954 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:10.556154 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:10.556155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:10.556155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:10.556423 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:10.556557 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:10.556683 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 17:41:10.556805 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260808 17:41:10.571314 16819 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:10.572083 16819 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:10.580497 16819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71: Generated new TSK 0
I20260808 17:41:10.580701 16819 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:41:10.607050 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33405
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:10.687840 16846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:10.688037 16846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:10.688058 16846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:10.689134 16846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:10.689164 16846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:10.689189 16846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:10.690711 16846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:10.690913 16846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:10.691139 16846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:10.695783 16852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:10.695829 16854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:10.695850 16859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:10.695894 16846 server_base.cc:1034] running on GCE node
I20260808 17:41:10.696321 16846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:10.696559 16846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:10.697701 16846 hybrid_clock.cc:648] HybridClock initialized: now 1786210870697678 us; error 40 us; skew 500 ppm
Aug 08 17:41:10 dist-test-slave-bqcl krb5kdc[16654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210870, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:10.700786 16846 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:41:10.701175 16846 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:10.701246 16846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:10.701457 16846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:10.702841 16846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "d4916e847a394387bf90714b1992a837"
format_stamp: "Formatted at 2026-08-08 17:41:10 on dist-test-slave-bqcl"
server_key: "ce1e9b46fdfd6b1513976f6f1cb81bd1"
server_key_iv: "2e2d73a87571a37530de30dc7a9ebdc0"
server_key_version: "encryptionkey@0"
I20260808 17:41:10.703177 16846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "d4916e847a394387bf90714b1992a837"
format_stamp: "Formatted at 2026-08-08 17:41:10 on dist-test-slave-bqcl"
server_key: "ce1e9b46fdfd6b1513976f6f1cb81bd1"
server_key_iv: "2e2d73a87571a37530de30dc7a9ebdc0"
server_key_version: "encryptionkey@0"
I20260808 17:41:10.704805 16846 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:41:10.705487 16869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:10.705629 16846 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:10.705711 16846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "d4916e847a394387bf90714b1992a837"
format_stamp: "Formatted at 2026-08-08 17:41:10 on dist-test-slave-bqcl"
server_key: "ce1e9b46fdfd6b1513976f6f1cb81bd1"
server_key_iv: "2e2d73a87571a37530de30dc7a9ebdc0"
server_key_version: "encryptionkey@0"
I20260808 17:41:10.705777 16846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:10.714572 16846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:10.716526 16846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:10.716647 16846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:10.717974 16846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:10.718279 16846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:10.718314 16846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:10.718341 16846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:10.718365 16846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:10.723809 16846 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:40855
I20260808 17:41:10.723857 17061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:40855 every 8 connection(s)
I20260808 17:41:10.724082 16846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:41:10 dist-test-slave-bqcl krb5kdc[16654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210870, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:10.732182 16805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:10.724701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:34477 (local address 127.9.187.254:33405)
0808 17:41:10.724750 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:10.724752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:10.724941 (+ 189us) server_negotiation.cc:407] Connection header received
0808 17:41:10.725391 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:10.725392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:10.725403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:10.725452 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:10.726370 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:10.726873 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:10.727798 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:10.727981 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:10.728025 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:10.729907 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:10.729909 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:10.729909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:10.729916 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:10.731099 (+ 1183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:10.731450 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:10.731450 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:10.731450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:10.731501 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:10.731700 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:10.731700 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:10.731700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:10.731802 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:10.731848 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:10.732052 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 17:41:10.732118 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:41:10.732345 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:10.724675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33405 (local address 127.9.187.193:34477)
0808 17:41:10.724825 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:10.724860 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:10.725313 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:10.725531 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:10.725534 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:10.725768 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:10.726298 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:10.726304 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:10.726941 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:10.726941 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:10.727734 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:10.727736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:10.728034 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:10.728034 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:10.728126 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:10.728498 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:10.728528 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:10.729826 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:10.731164 (+ 1338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:10.731171 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:10.731173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:10.731390 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:10.731552 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:10.731553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:10.731553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:10.731653 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:10.731846 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:10.731849 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:10.731958 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 17:41:10.732036 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 17:41:10.732150 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
I20260808 17:41:10.732442 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 16846
I20260808 17:41:10.732550 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:10.732740 9967 external_mini_cluster.cc:1428] Setting key e434b16cd7d7413f39bd4545369231fb
I20260808 17:41:10.732910 17062 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33405
I20260808 17:41:10.732999 17062 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:10.733139 17062 heartbeater.cc:511] Master 127.9.187.254:33405 requested a full tablet report, sending...
I20260808 17:41:10.733690 16739 ts_manager.cc:194] Registered new tserver with Master: d4916e847a394387bf90714b1992a837 (127.9.187.193:40855)
I20260808 17:41:10.734484 16739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:34477
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:41:10.757081 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33405
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:10.837783 17071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:10.837994 17071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:10.838025 17071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:10.839159 17071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:10.839202 17071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:10.839229 17071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:10.840672 17071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:10.840868 17071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:10.841058 17071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:41:10.845811 17071 server_base.cc:1034] running on GCE node
W20260808 17:41:10.845754 17083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:10.845754 17077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:10.845777 17080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:10.846217 17071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:10.846469 17071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:10.847612 17071 hybrid_clock.cc:648] HybridClock initialized: now 1786210870847596 us; error 28 us; skew 500 ppm
Aug 08 17:41:10 dist-test-slave-bqcl krb5kdc[16654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210870, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:10.849975 17071 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:41:10.850330 17071 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:10.850385 17071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:10.850512 17071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:10.851594 17071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "266480d28f0a438fb4aa8914838fdd67"
format_stamp: "Formatted at 2026-08-08 17:41:10 on dist-test-slave-bqcl"
server_key: "5505d7a35b1b28461a250344fc9de0b9"
server_key_iv: "503be55e0c8694a1b6038bb308e7dbe7"
server_key_version: "encryptionkey@0"
I20260808 17:41:10.851923 17071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "266480d28f0a438fb4aa8914838fdd67"
format_stamp: "Formatted at 2026-08-08 17:41:10 on dist-test-slave-bqcl"
server_key: "5505d7a35b1b28461a250344fc9de0b9"
server_key_iv: "503be55e0c8694a1b6038bb308e7dbe7"
server_key_version: "encryptionkey@0"
I20260808 17:41:10.853157 17071 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:41:10.853854 17092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:10.854004 17071 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:10.854089 17071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "266480d28f0a438fb4aa8914838fdd67"
format_stamp: "Formatted at 2026-08-08 17:41:10 on dist-test-slave-bqcl"
server_key: "5505d7a35b1b28461a250344fc9de0b9"
server_key_iv: "503be55e0c8694a1b6038bb308e7dbe7"
server_key_version: "encryptionkey@0"
I20260808 17:41:10.854173 17071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:10.871063 17071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:10.872742 17071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:10.872879 17071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:10.873082 17071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:10.873440 17071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:10.873481 17071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:10.873510 17071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:10.873538 17071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:10.879037 17071 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:36507
I20260808 17:41:10.879099 17294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:36507 every 8 connection(s)
I20260808 17:41:10.879333 17071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:41:10.881989 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 17071
I20260808 17:41:10.882097 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:10.882329 9967 external_mini_cluster.cc:1428] Setting key 7f2ffd897131026c300f296ed6b7ca93
Aug 08 17:41:10 dist-test-slave-bqcl krb5kdc[16654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210870, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:10.888662 16805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:10.879950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:42739 (local address 127.9.187.254:33405)
0808 17:41:10.879999 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:10.880001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:10.880197 (+ 196us) server_negotiation.cc:407] Connection header received
0808 17:41:10.880691 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:10.880693 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:10.880706 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:10.880767 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:10.881704 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:10.882446 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:10.883552 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:10.883763 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:10.883818 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:10.886099 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:10.886100 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:10.886100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:10.886108 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:10.887409 (+ 1301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:10.887773 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:10.887775 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:10.887775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:10.887834 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:10.888050 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:10.888051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:10.888051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:10.888167 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:10.888222 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:10.888490 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 17:41:10.888573 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:41:10.888820 17301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:10.879919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33405 (local address 127.9.187.194:42739)
0808 17:41:10.880084 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:10.880118 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:10.880592 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:10.880849 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:10.880853 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:10.881111 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:10.881603 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:10.881608 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:10.882542 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:10.882543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:10.883466 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:10.883469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:10.883831 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:10.883832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:10.883963 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:10.884420 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:10.884428 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:10.886006 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:10.887484 (+ 1478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:10.887492 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:10.887494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:10.887702 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:10.887886 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:10.887887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:10.887887 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:10.887995 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:10.888221 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:10.888228 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:10.888367 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 17:41:10.888457 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 17:41:10.888609 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260808 17:41:10.889343 17298 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33405
I20260808 17:41:10.889448 17298 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:10.889609 17298 heartbeater.cc:511] Master 127.9.187.254:33405 requested a full tablet report, sending...
I20260808 17:41:10.890012 16739 ts_manager.cc:194] Registered new tserver with Master: 266480d28f0a438fb4aa8914838fdd67 (127.9.187.194:36507)
I20260808 17:41:10.890416 16739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:42739
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:41:10.908963 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33405
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:10.989534 17306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:10.989737 17306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:10.989758 17306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:10.990850 17306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:10.990885 17306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:10.990909 17306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:10.992302 17306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:10.992481 17306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:10.992648 17306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:10.997403 17317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:10.997394 17314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:10.997421 17321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:10.997789 17306 server_base.cc:1034] running on GCE node
I20260808 17:41:10.998018 17306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:10.998265 17306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:10.999413 17306 hybrid_clock.cc:648] HybridClock initialized: now 1786210870999400 us; error 31 us; skew 500 ppm
Aug 08 17:41:10 dist-test-slave-bqcl krb5kdc[16654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210870, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:11.001945 17306 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:41:11.002291 17306 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:11.002346 17306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:11.002475 17306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:11.003448 17306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "1b62d31d51bc4883bffd6814f6f842e6"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "8f678baba3ae3b86c71c0b752b8c38f8"
server_key_iv: "6aca9e2ebba11e15014507f2703c87eb"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.003808 17306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "1b62d31d51bc4883bffd6814f6f842e6"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "8f678baba3ae3b86c71c0b752b8c38f8"
server_key_iv: "6aca9e2ebba11e15014507f2703c87eb"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.004967 17306 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:11.005615 17329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.005781 17306 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:11.005864 17306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "1b62d31d51bc4883bffd6814f6f842e6"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "8f678baba3ae3b86c71c0b752b8c38f8"
server_key_iv: "6aca9e2ebba11e15014507f2703c87eb"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.005930 17306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:11.025426 17306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:11.027419 17306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:11.027575 17306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:11.027792 17306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:11.028090 17306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:11.028123 17306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.028153 17306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:11.028177 17306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.033763 17306 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:34483
I20260808 17:41:11.033821 17515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:34483 every 8 connection(s)
I20260808 17:41:11.034065 17306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:41:11 dist-test-slave-bqcl krb5kdc[16654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210870, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:11.042726 16805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.034743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:59657 (local address 127.9.187.254:33405)
0808 17:41:11.034794 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.034796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.034990 (+ 194us) server_negotiation.cc:407] Connection header received
0808 17:41:11.035486 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.035487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.035500 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.035552 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.036471 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.036968 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.037939 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.038193 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.038253 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.040241 (+ 1988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.040243 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.040243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:11.040250 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.041384 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:11.041765 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:11.041766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:11.041767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:11.041823 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:11.042032 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:11.042032 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:11.042033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:11.042200 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.042254 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.042561 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.042637 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:41:11.042862 17521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.034709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33405 (local address 127.9.187.195:59657)
0808 17:41:11.034874 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.034910 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.035390 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.035645 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.035648 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.035896 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:11.036378 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.036383 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.037050 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.037050 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.037848 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.037851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.038261 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.038262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.038380 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.038797 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:11.038806 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:11.040153 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:11.041457 (+ 1304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:11.041463 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:11.041465 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:11.041696 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:11.041877 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:11.041877 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:11.041878 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:11.041976 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:11.042264 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:11.042271 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:11.042407 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.042524 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.042684 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
I20260808 17:41:11.043253 17516 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33405
I20260808 17:41:11.043339 17516 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:11.043474 17516 heartbeater.cc:511] Master 127.9.187.254:33405 requested a full tablet report, sending...
I20260808 17:41:11.043877 16739 ts_manager.cc:194] Registered new tserver with Master: 1b62d31d51bc4883bffd6814f6f842e6 (127.9.187.195:34483)
I20260808 17:41:11.044242 16739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:59657
I20260808 17:41:11.044251 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 17306
I20260808 17:41:11.044343 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:11.044534 9967 external_mini_cluster.cc:1428] Setting key a54da181898411aced36215f01a612d2
I20260808 17:41:11.045344 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:41:11.051892 16805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.046549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38988 (local address 127.9.187.254:33405)
0808 17:41:11.046598 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.046599 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.046744 (+ 145us) server_negotiation.cc:407] Connection header received
0808 17:41:11.046806 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.046806 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.046816 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.046869 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.047397 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.047855 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.048549 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.048747 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.048801 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.049822 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.049823 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.049823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:11.049829 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.050867 (+ 1038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:11.051160 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:11.051161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:11.051161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:11.051213 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:11.051372 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:11.051373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:11.051373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:11.051509 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.051599 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.051737 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.051805 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:41:11.053454 16739 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38988:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:41:11.055043 16739 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:41:11.060949 17540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.057246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47584 (local address 127.9.187.195:34483)
0808 17:41:11.057426 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.057431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.057443 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:41:11.057482 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.057484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.057500 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.057589 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:11.057759 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.058865 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.060100 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.060557 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.060623 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.060682 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.060828 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.060868 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":74,"threads_started":1}
I20260808 17:41:11.060940 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.057032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:34483 (local address 127.0.0.1:47584)
0808 17:41:11.057137 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.057178 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.057242 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.057605 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.057608 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.057614 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:11.057701 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.057703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.058958 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.058959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.060002 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.060003 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.060636 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.060637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.060734 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.060748 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.060807 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.060871 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"mutex_wait_us":1,"thread_start_us":55,"threads_started":1}
I20260808 17:41:11.061251 17542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.057289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45532 (local address 127.9.187.193:40855)
0808 17:41:11.057454 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.057458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.057467 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:11.057501 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.057503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.057516 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.057601 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:11.057769 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.058632 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.060062 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.060771 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.060836 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.060889 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.061139 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.061179 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":87,"threads_started":1}
I20260808 17:41:11.061340 17541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.057260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59510 (local address 127.9.187.194:36507)
0808 17:41:11.057753 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.057757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.057767 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:11.057800 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.057802 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.057816 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.057892 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:11.058150 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.059100 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.060086 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.060769 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.060836 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.060889 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.061230 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.061268 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":64,"threads_started":1}
I20260808 17:41:11.061170 17537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.057044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:36507 (local address 127.0.0.1:59510)
0808 17:41:11.057451 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.057459 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.057497 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.057974 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.057975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.057977 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:11.058047 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.058048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.059181 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.059182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.060006 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.060008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.060927 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.060928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.061000 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.061006 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.061052 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.061092 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":4,"thread_start_us":43,"threads_started":1}
I20260808 17:41:11.061627 17534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.057041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:40855 (local address 127.0.0.1:45532)
0808 17:41:11.057338 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.057346 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.057381 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.057605 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.057608 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.057610 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:11.057683 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.057685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.058718 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.058719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.059978 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.059981 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.060927 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.060928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.061000 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.061005 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.061064 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.061098 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":9,"thread_start_us":60,"threads_started":1}
I20260808 17:41:11.061997 17415 tablet_service.cc:1467] Processing CreateTablet for tablet fb7a4a3564c54387aa25a422deaf831b (DEFAULT_TABLE table=test-table [id=f60b5382b3984cbd9aaf32a415c871dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:11.062182 17187 tablet_service.cc:1467] Processing CreateTablet for tablet fb7a4a3564c54387aa25a422deaf831b (DEFAULT_TABLE table=test-table [id=f60b5382b3984cbd9aaf32a415c871dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:11.062393 17415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7a4a3564c54387aa25a422deaf831b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:11.062319 16950 tablet_service.cc:1467] Processing CreateTablet for tablet fb7a4a3564c54387aa25a422deaf831b (DEFAULT_TABLE table=test-table [id=f60b5382b3984cbd9aaf32a415c871dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:11.062470 17187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7a4a3564c54387aa25a422deaf831b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:11.062621 16950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7a4a3564c54387aa25a422deaf831b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:11.064880 17543 tablet_bootstrap.cc:492] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67: Bootstrap starting.
I20260808 17:41:11.065567 17545 tablet_bootstrap.cc:492] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6: Bootstrap starting.
I20260808 17:41:11.065733 17543 tablet_bootstrap.cc:654] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:11.066249 17545 tablet_bootstrap.cc:654] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:11.066382 17543 log.cc:824] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:11.066790 17544 tablet_bootstrap.cc:492] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837: Bootstrap starting.
I20260808 17:41:11.066833 17545 log.cc:824] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:11.067145 17543 tablet_bootstrap.cc:492] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67: No bootstrap required, opened a new log
I20260808 17:41:11.067221 17543 ts_tablet_manager.cc:1397] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:41:11.067337 17544 tablet_bootstrap.cc:654] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:11.067910 17545 tablet_bootstrap.cc:492] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6: No bootstrap required, opened a new log
I20260808 17:41:11.067911 17544 log.cc:824] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:11.067979 17545 ts_tablet_manager.cc:1397] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:41:11.068666 17544 tablet_bootstrap.cc:492] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837: No bootstrap required, opened a new log
I20260808 17:41:11.068740 17544 ts_tablet_manager.cc:1397] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:11.068930 17543 raft_consensus.cc:348] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266480d28f0a438fb4aa8914838fdd67" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36507 } } peers { permanent_uuid: "1b62d31d51bc4883bffd6814f6f842e6" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 34483 } } peers { permanent_uuid: "d4916e847a394387bf90714b1992a837" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40855 } }
I20260808 17:41:11.069074 17543 raft_consensus.cc:374] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:11.069113 17543 raft_consensus.cc:729] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266480d28f0a438fb4aa8914838fdd67, State: Initialized, Role: FOLLOWER
I20260808 17:41:11.069222 17543 consensus_queue.cc:260] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266480d28f0a438fb4aa8914838fdd67" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36507 } } peers { permanent_uuid: "1b62d31d51bc4883bffd6814f6f842e6" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 34483 } } peers { permanent_uuid: "d4916e847a394387bf90714b1992a837" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40855 } }
I20260808 17:41:11.069476 17543 ts_tablet_manager.cc:1428] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:41:11.069600 17298 heartbeater.cc:503] Master 127.9.187.254:33405 was elected leader, sending a full tablet report...
I20260808 17:41:11.069784 17545 raft_consensus.cc:348] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266480d28f0a438fb4aa8914838fdd67" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36507 } } peers { permanent_uuid: "1b62d31d51bc4883bffd6814f6f842e6" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 34483 } } peers { permanent_uuid: "d4916e847a394387bf90714b1992a837" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40855 } }
I20260808 17:41:11.070384 17545 raft_consensus.cc:374] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:11.070436 17545 raft_consensus.cc:729] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b62d31d51bc4883bffd6814f6f842e6, State: Initialized, Role: FOLLOWER
I20260808 17:41:11.070693 17545 consensus_queue.cc:260] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266480d28f0a438fb4aa8914838fdd67" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36507 } } peers { permanent_uuid: "1b62d31d51bc4883bffd6814f6f842e6" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 34483 } } peers { permanent_uuid: "d4916e847a394387bf90714b1992a837" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40855 } }
I20260808 17:41:11.070691 17544 raft_consensus.cc:348] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266480d28f0a438fb4aa8914838fdd67" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36507 } } peers { permanent_uuid: "1b62d31d51bc4883bffd6814f6f842e6" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 34483 } } peers { permanent_uuid: "d4916e847a394387bf90714b1992a837" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40855 } }
I20260808 17:41:11.070839 17544 raft_consensus.cc:374] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:11.070886 17544 raft_consensus.cc:729] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4916e847a394387bf90714b1992a837, State: Initialized, Role: FOLLOWER
I20260808 17:41:11.070981 17545 ts_tablet_manager.cc:1428] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 17:41:11.070996 17544 consensus_queue.cc:260] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266480d28f0a438fb4aa8914838fdd67" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36507 } } peers { permanent_uuid: "1b62d31d51bc4883bffd6814f6f842e6" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 34483 } } peers { permanent_uuid: "d4916e847a394387bf90714b1992a837" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40855 } }
I20260808 17:41:11.071026 17516 heartbeater.cc:503] Master 127.9.187.254:33405 was elected leader, sending a full tablet report...
I20260808 17:41:11.071298 17062 heartbeater.cc:503] Master 127.9.187.254:33405 was elected leader, sending a full tablet report...
I20260808 17:41:11.071338 17544 ts_tablet_manager.cc:1428] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:41:11.088526 17551 raft_consensus.cc:482] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:11.088681 17551 raft_consensus.cc:504] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266480d28f0a438fb4aa8914838fdd67" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36507 } } peers { permanent_uuid: "1b62d31d51bc4883bffd6814f6f842e6" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 34483 } } peers { permanent_uuid: "d4916e847a394387bf90714b1992a837" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40855 } }
I20260808 17:41:11.089003 17551 leader_election.cc:288] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b62d31d51bc4883bffd6814f6f842e6 (127.9.187.195:34483), d4916e847a394387bf90714b1992a837 (127.9.187.193:40855)
I20260808 17:41:11.091619 17542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.089254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:42899 (local address 127.9.187.193:40855)
0808 17:41:11.089294 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.089296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.089304 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:11.089327 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.089327 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.089336 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.089382 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:11.089524 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.089992 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.090970 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.091318 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.091378 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.091387 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.091518 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.091551 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:41:11.091619 17301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.089166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:40855 (local address 127.9.187.194:42899)
0808 17:41:11.089229 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.089240 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.089278 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.089389 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.089390 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.089392 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:11.089459 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.089461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.090060 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.090061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.090882 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.090884 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.091384 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.091385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.091458 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.091461 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.091504 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.091541 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":1}
I20260808 17:41:11.091663 17540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.089196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:49459 (local address 127.9.187.195:34483)
0808 17:41:11.089267 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.089269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.089417 (+ 148us) server_negotiation.cc:407] Connection header received
0808 17:41:11.089459 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.089460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.089468 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.089510 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:11.089640 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.090097 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.091018 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.091379 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.091441 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.091448 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.091571 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.091606 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 17:41:11.091897 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.089165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:34483 (local address 127.9.187.194:49459)
0808 17:41:11.089343 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.089351 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.089406 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.089516 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.089517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.089518 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:11.089586 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.089588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.090195 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.090196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.090938 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:11.090940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.091448 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.091449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:11.091513 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.091515 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.091559 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.091599 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":14,"thread_start_us":118,"threads_started":1}
I20260808 17:41:11.091938 16981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7a4a3564c54387aa25a422deaf831b" candidate_uuid: "266480d28f0a438fb4aa8914838fdd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4916e847a394387bf90714b1992a837" is_pre_election: true
I20260808 17:41:11.092068 16981 raft_consensus.cc:2454] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266480d28f0a438fb4aa8914838fdd67 in term 0.
I20260808 17:41:11.092240 17443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7a4a3564c54387aa25a422deaf831b" candidate_uuid: "266480d28f0a438fb4aa8914838fdd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b62d31d51bc4883bffd6814f6f842e6" is_pre_election: true
I20260808 17:41:11.092275 17095 leader_election.cc:302] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266480d28f0a438fb4aa8914838fdd67, d4916e847a394387bf90714b1992a837; no voters:
I20260808 17:41:11.092367 17443 raft_consensus.cc:2454] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266480d28f0a438fb4aa8914838fdd67 in term 0.
I20260808 17:41:11.092384 17551 raft_consensus.cc:2781] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:41:11.092434 17551 raft_consensus.cc:482] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:11.092466 17551 raft_consensus.cc:3037] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:11.093181 17551 raft_consensus.cc:504] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266480d28f0a438fb4aa8914838fdd67" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36507 } } peers { permanent_uuid: "1b62d31d51bc4883bffd6814f6f842e6" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 34483 } } peers { permanent_uuid: "d4916e847a394387bf90714b1992a837" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40855 } }
I20260808 17:41:11.093317 17551 leader_election.cc:288] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [CANDIDATE]: Term 1 election: Requested vote from peers 1b62d31d51bc4883bffd6814f6f842e6 (127.9.187.195:34483), d4916e847a394387bf90714b1992a837 (127.9.187.193:40855)
I20260808 17:41:11.093436 17443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7a4a3564c54387aa25a422deaf831b" candidate_uuid: "266480d28f0a438fb4aa8914838fdd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b62d31d51bc4883bffd6814f6f842e6"
I20260808 17:41:11.093461 16981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7a4a3564c54387aa25a422deaf831b" candidate_uuid: "266480d28f0a438fb4aa8914838fdd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4916e847a394387bf90714b1992a837"
I20260808 17:41:11.093509 17443 raft_consensus.cc:3037] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:11.093532 16981 raft_consensus.cc:3037] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:11.094272 16981 raft_consensus.cc:2454] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266480d28f0a438fb4aa8914838fdd67 in term 1.
I20260808 17:41:11.094272 17443 raft_consensus.cc:2454] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266480d28f0a438fb4aa8914838fdd67 in term 1.
I20260808 17:41:11.094429 17095 leader_election.cc:302] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266480d28f0a438fb4aa8914838fdd67, d4916e847a394387bf90714b1992a837; no voters:
I20260808 17:41:11.094529 17551 raft_consensus.cc:2781] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:11.094691 17551 raft_consensus.cc:686] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 1 LEADER]: Becoming Leader. State: Replica: 266480d28f0a438fb4aa8914838fdd67, State: Running, Role: LEADER
I20260808 17:41:11.094779 17551 consensus_queue.cc:237] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266480d28f0a438fb4aa8914838fdd67" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36507 } } peers { permanent_uuid: "1b62d31d51bc4883bffd6814f6f842e6" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 34483 } } peers { permanent_uuid: "d4916e847a394387bf90714b1992a837" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40855 } }
I20260808 17:41:11.095578 16737 catalog_manager.cc:5495] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 266480d28f0a438fb4aa8914838fdd67 (127.9.187.194). New cstate: current_term: 1 leader_uuid: "266480d28f0a438fb4aa8914838fdd67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266480d28f0a438fb4aa8914838fdd67" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b62d31d51bc4883bffd6814f6f842e6" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 34483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4916e847a394387bf90714b1992a837" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40855 } health_report { overall_health: UNKNOWN } } }
I20260808 17:41:11.109123 17541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.106923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59524 (local address 127.9.187.194:36507)
0808 17:41:11.106966 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.106968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.106975 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:41:11.107020 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.107021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.107037 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.107094 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:11.107208 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.107680 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.108432 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:11.108634 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:11.108681 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:11.108837 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:11.108931 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:11.108986 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.109000 (+ 14us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.109016 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:41:11.110855 16981 raft_consensus.cc:1261] T fb7a4a3564c54387aa25a422deaf831b P d4916e847a394387bf90714b1992a837 [term 1 FOLLOWER]: Refusing update from remote peer 266480d28f0a438fb4aa8914838fdd67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:11.110855 17443 raft_consensus.cc:1261] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6 [term 1 FOLLOWER]: Refusing update from remote peer 266480d28f0a438fb4aa8914838fdd67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:11.111193 17557 consensus_queue.cc:1035] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4916e847a394387bf90714b1992a837" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:11.111311 17551 consensus_queue.cc:1035] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b62d31d51bc4883bffd6814f6f842e6" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:11.114226 17563 mvcc.cc:205] Tried to move back new op lower bound from 7316319728067657728 to 7316319728004833280. Current Snapshot: MvccSnapshot[applied={T|T < 7316319728067657728}]
I20260808 17:41:11.115677 16739 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:11.115773 16739 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:11.116460 16739 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0cc87691661c47a7ae9950df6071ad71: Sending DeleteTablet for 3 replicas of tablet fb7a4a3564c54387aa25a422deaf831b
I20260808 17:41:11.116755 17187 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7a4a3564c54387aa25a422deaf831b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:11 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:59510
I20260808 17:41:11.116812 16950 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7a4a3564c54387aa25a422deaf831b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:11 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:45532
I20260808 17:41:11.116807 17415 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7a4a3564c54387aa25a422deaf831b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:11 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:47584
I20260808 17:41:11.117071 17581 tablet_replica.cc:330] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67: stopping tablet replica
I20260808 17:41:11.117095 17584 tablet_replica.cc:330] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6: stopping tablet replica
I20260808 17:41:11.117282 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 16846
I20260808 17:41:11.117197 17584 raft_consensus.cc:2229] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:11.120434 17584 raft_consensus.cc:2258] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:11.122360 17584 ts_tablet_manager.cc:1905] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:11.123770 17584 ts_tablet_manager.cc:1918] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:11.123833 17584 log.cc:1196] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/fb7a4a3564c54387aa25a422deaf831b
I20260808 17:41:11.124099 17584 ts_tablet_manager.cc:1939] T fb7a4a3564c54387aa25a422deaf831b P 1b62d31d51bc4883bffd6814f6f842e6: Deleting consensus metadata
I20260808 17:41:11.124486 16716 catalog_manager.cc:4841] TS 1b62d31d51bc4883bffd6814f6f842e6 (127.9.187.195:34483): tablet fb7a4a3564c54387aa25a422deaf831b (table test-table [id=f60b5382b3984cbd9aaf32a415c871dd]) successfully deleted
I20260808 17:41:11.117223 17581 raft_consensus.cc:2229] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:41:11.128422 17581 raft_consensus.cc:2258] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:11.128945 17581 ts_tablet_manager.cc:1905] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:11.130570 17581 ts_tablet_manager.cc:1918] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:11.130645 17581 log.cc:1196] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/fb7a4a3564c54387aa25a422deaf831b
I20260808 17:41:11.130903 17581 ts_tablet_manager.cc:1939] T fb7a4a3564c54387aa25a422deaf831b P 266480d28f0a438fb4aa8914838fdd67: Deleting consensus metadata
I20260808 17:41:11.131296 16714 catalog_manager.cc:4841] TS 266480d28f0a438fb4aa8914838fdd67 (127.9.187.194:36507): tablet fb7a4a3564c54387aa25a422deaf831b (table test-table [id=f60b5382b3984cbd9aaf32a415c871dd]) successfully deleted
W20260808 17:41:11.133074 16713 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:40855 (error 108)
I20260808 17:41:11.133309 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 17071
I20260808 17:41:11.142284 17534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.142092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:40855 (local address 127.0.0.1:45548)
0808 17:41:11.142200 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.142246 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:40855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260808 17:41:11.142414 16713 catalog_manager.cc:4584] TS d4916e847a394387bf90714b1992a837 (127.9.187.193:40855): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fb7a4a3564c54387aa25a422deaf831b: Network error: Client connection negotiation failed: client connection to 127.9.187.193:40855: connect: Connection refused (error 111)
I20260808 17:41:11.145927 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 17306
I20260808 17:41:11.153357 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 16688
2026-08-08T17:41:11Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (1988 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T17:41:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:11Z Disabled control of system clock
I20260808 17:41:11.186300 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41039
--webserver_interface=127.9.187.254
--webserver_port=0
--builtin_ntp_servers=127.9.187.212:42793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:41039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 17:41:11.266417 17594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:11.266615 17594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:11.266635 17594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:11.267720 17594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:11.267760 17594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:11.267772 17594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:11.267784 17594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:11.267794 17594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:11.269057 17594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:41039
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:11.269241 17594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:11.269469 17594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:11.273976 17607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:11.274061 17594 server_base.cc:1034] running on GCE node
W20260808 17:41:11.274091 17603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:11.274152 17613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:11.274459 17594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:11.274740 17594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:11.275877 17594 hybrid_clock.cc:648] HybridClock initialized: now 1786210871275857 us; error 38 us; skew 500 ppm
I20260808 17:41:11.277040 17594 webserver.cc:460] Webserver started at http://127.9.187.254:37873/ using document root <none> and password file <none>
I20260808 17:41:11.277240 17594 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:11.277289 17594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:11.277412 17594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:11.278439 17594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "5990e86197184ecba3125711a32a4ff7"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "32d2e05eb3fd0fffb6ef286a99b51180"
server_key_iv: "8518bf2feef78d22eb1703a3a85d5c53"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.278770 17594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "5990e86197184ecba3125711a32a4ff7"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "32d2e05eb3fd0fffb6ef286a99b51180"
server_key_iv: "8518bf2feef78d22eb1703a3a85d5c53"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.279983 17594 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:11.280685 17620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.280834 17594 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:11.280917 17594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "5990e86197184ecba3125711a32a4ff7"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "32d2e05eb3fd0fffb6ef286a99b51180"
server_key_iv: "8518bf2feef78d22eb1703a3a85d5c53"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.280987 17594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:11.284176 17594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:11.284438 17594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:11.284554 17594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:11.288244 17594 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:41039
I20260808 17:41:11.288270 17713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:41039 every 8 connection(s)
I20260808 17:41:11.288565 17594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:11.289156 17714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:11.290086 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 17594
I20260808 17:41:11.290201 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:11.290364 9967 external_mini_cluster.cc:1428] Setting key 18f8ca7499d725d59cc50240b39f3baa
I20260808 17:41:11.292289 17714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7: Bootstrap starting.
I20260808 17:41:11.292639 17717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.290840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57324 (local address 127.9.187.254:41039)
0808 17:41:11.291026 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.291033 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.291058 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:41:11.291440 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.291446 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.291483 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.291591 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.292216 (+ 625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.292219 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.292219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:11.292223 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.292266 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:11.292277 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.292329 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.292409 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.292462 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260808 17:41:11.292953 17714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:11.293234 17714 log.cc:824] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:11.293859 17714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7: No bootstrap required, opened a new log
I20260808 17:41:11.295152 17714 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5990e86197184ecba3125711a32a4ff7" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41039 } }
I20260808 17:41:11.295276 17714 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:11.295307 17714 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5990e86197184ecba3125711a32a4ff7, State: Initialized, Role: FOLLOWER
I20260808 17:41:11.295421 17714 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5990e86197184ecba3125711a32a4ff7" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41039 } }
I20260808 17:41:11.295492 17714 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:11.295516 17714 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:11.295589 17714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:11.296075 17714 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5990e86197184ecba3125711a32a4ff7" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41039 } }
I20260808 17:41:11.296165 17714 leader_election.cc:302] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5990e86197184ecba3125711a32a4ff7; no voters:
I20260808 17:41:11.296311 17714 leader_election.cc:288] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:11.296525 17714 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:11.296572 17719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:11.296743 17719 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [term 1 LEADER]: Becoming Leader. State: Replica: 5990e86197184ecba3125711a32a4ff7, State: Running, Role: LEADER
I20260808 17:41:11.296855 17719 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5990e86197184ecba3125711a32a4ff7" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41039 } }
I20260808 17:41:11.297224 17724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5990e86197184ecba3125711a32a4ff7. Latest consensus state: current_term: 1 leader_uuid: "5990e86197184ecba3125711a32a4ff7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5990e86197184ecba3125711a32a4ff7" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41039 } } }
I20260808 17:41:11.297204 17722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5990e86197184ecba3125711a32a4ff7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5990e86197184ecba3125711a32a4ff7" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41039 } } }
I20260808 17:41:11.297353 17724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:11.297360 17722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:11.297616 17738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:11.298117 17738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:11.302953 17738 catalog_manager.cc:1347] Generated new cluster ID: 2d26f79d221540e39b87984a532e43f4
I20260808 17:41:11.302999 17738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:11.315155 17738 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:11.315304 17738 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:11.317708 17738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7: Generated new TSK 0
I20260808 17:41:11.317860 17738 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:41:11.319092 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41039
--builtin_ntp_servers=127.9.187.212:42793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 17:41:11.405972 17757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:11.406203 17757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:11.406237 17757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:11.407354 17757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:11.407399 17757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:11.407436 17757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:11.408751 17757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:11.408979 17757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:11.409250 17757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:11.414928 17766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:11.414950 17768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:11.415175 17771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:11.415207 17757 server_base.cc:1034] running on GCE node
I20260808 17:41:11.415405 17757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:11.415654 17757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:11.416829 17757 hybrid_clock.cc:648] HybridClock initialized: now 1786210871416815 us; error 27 us; skew 500 ppm
I20260808 17:41:11.418363 17757 webserver.cc:460] Webserver started at http://127.9.187.193:42975/ using document root <none> and password file <none>
I20260808 17:41:11.418619 17757 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:11.418686 17757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:11.418817 17757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:11.420156 17757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "03f650dd76ce4a858b2386e0b43348f2"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "4a60653aeddc546c36469bd75ded7b57"
server_key_iv: "63e78cf67a5b8e981e5c2a9743d09bb8"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.420543 17757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "03f650dd76ce4a858b2386e0b43348f2"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "4a60653aeddc546c36469bd75ded7b57"
server_key_iv: "63e78cf67a5b8e981e5c2a9743d09bb8"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.421989 17757 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:11.422811 17781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.422964 17757 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:11.423048 17757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "03f650dd76ce4a858b2386e0b43348f2"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "4a60653aeddc546c36469bd75ded7b57"
server_key_iv: "63e78cf67a5b8e981e5c2a9743d09bb8"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.423120 17757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:11.426306 17757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:11.426548 17757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:11.426661 17757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:11.426858 17757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:11.427171 17757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:11.427203 17757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.427232 17757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:11.427254 17757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.432616 17757 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:43059
I20260808 17:41:11.432675 17971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:43059 every 8 connection(s)
I20260808 17:41:11.432941 17757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:41:11.434998 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 17757
I20260808 17:41:11.435094 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:11.435271 9967 external_mini_cluster.cc:1428] Setting key 604a4f10c7f67e461c6cb1fd77c7517d
I20260808 17:41:11.435891 17717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.433587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:36091 (local address 127.9.187.254:41039)
0808 17:41:11.433629 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.433630 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.433855 (+ 225us) server_negotiation.cc:407] Connection header received
0808 17:41:11.434338 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.434340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.434347 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.434406 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.435660 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.435661 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.435661 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:11.435665 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.435680 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:11.435685 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.435734 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.435810 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.435821 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:41:11.436080 17976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.433570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:41039 (local address 127.9.187.193:36091)
0808 17:41:11.433750 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.433781 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.434247 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.434473 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.434477 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.434486 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:11.435477 (+ 991us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:11.435478 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:11.435517 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:11.435585 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:11.435736 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:11.435740 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:11.435749 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.435821 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.435882 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
I20260808 17:41:11.436321 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41039
--builtin_ntp_servers=127.9.187.212:42793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 17:41:11.437770 17973 heartbeater.cc:347] Connected to a master server at 127.9.187.254:41039
I20260808 17:41:11.437860 17973 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:11.437996 17973 heartbeater.cc:511] Master 127.9.187.254:41039 requested a full tablet report, sending...
I20260808 17:41:11.438562 17651 ts_manager.cc:194] Registered new tserver with Master: 03f650dd76ce4a858b2386e0b43348f2 (127.9.187.193:43059)
W20260808 17:41:11.516989 17978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:11.517184 17978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:11.517215 17978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:11.518354 17978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:11.518393 17978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:11.518426 17978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:11.519711 17978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:11.519936 17978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:11.520195 17978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:11.525060 17993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:11.525123 17988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:11.525056 17987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:11.525285 17978 server_base.cc:1034] running on GCE node
I20260808 17:41:11.525487 17978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:11.525740 17978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:11.526895 17978 hybrid_clock.cc:648] HybridClock initialized: now 1786210871526883 us; error 29 us; skew 500 ppm
I20260808 17:41:11.528040 17978 webserver.cc:460] Webserver started at http://127.9.187.194:44633/ using document root <none> and password file <none>
I20260808 17:41:11.528268 17978 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:11.528317 17978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:11.528445 17978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:11.529431 17978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "331099999aaf4a3eaaa7f367589757e0"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "0a133e5b5e4afabafba8286a31d3b0a7"
server_key_iv: "606df01e958cb2c3d544ac21d7e5659c"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.529763 17978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "331099999aaf4a3eaaa7f367589757e0"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "0a133e5b5e4afabafba8286a31d3b0a7"
server_key_iv: "606df01e958cb2c3d544ac21d7e5659c"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.530995 17978 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:41:11.531627 18001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.531764 17978 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:11.531845 17978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "331099999aaf4a3eaaa7f367589757e0"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "0a133e5b5e4afabafba8286a31d3b0a7"
server_key_iv: "606df01e958cb2c3d544ac21d7e5659c"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.531910 17978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:11.535106 17978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:11.535349 17978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:11.535444 17978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:11.535594 17978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:11.535818 17978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:11.535847 17978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.535866 17978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:11.535882 17978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.541009 17978 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:40071
I20260808 17:41:11.541069 18186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:40071 every 8 connection(s)
I20260808 17:41:11.541312 17978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:41:11.541875 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 17978
I20260808 17:41:11.541983 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:11.542196 9967 external_mini_cluster.cc:1428] Setting key 203914717460d090d18202401bf99a8d
I20260808 17:41:11.543076 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41039
--builtin_ntp_servers=127.9.187.212:42793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 17:41:11.544139 17717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.541908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:36675 (local address 127.9.187.254:41039)
0808 17:41:11.541953 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.541955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.542257 (+ 302us) server_negotiation.cc:407] Connection header received
0808 17:41:11.542743 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.542744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.542750 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.542795 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.543910 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.543911 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.543911 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:11.543916 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.543932 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:11.543936 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.543986 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.544054 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.544068 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:41:11.544317 18192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.541919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:41039 (local address 127.9.187.194:36675)
0808 17:41:11.542115 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.542174 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.542652 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.542857 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.542861 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.542871 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:11.543771 (+ 900us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:11.543771 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:11.543798 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:11.543824 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:11.543990 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:11.543995 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:11.543998 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.544065 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.544124 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":93,"threads_started":1}
I20260808 17:41:11.544792 18190 heartbeater.cc:347] Connected to a master server at 127.9.187.254:41039
I20260808 17:41:11.544888 18190 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:11.545027 18190 heartbeater.cc:511] Master 127.9.187.254:41039 requested a full tablet report, sending...
I20260808 17:41:11.545364 17651 ts_manager.cc:194] Registered new tserver with Master: 331099999aaf4a3eaaa7f367589757e0 (127.9.187.194:40071)
W20260808 17:41:11.623265 18193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:11.623464 18193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:11.623484 18193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:11.624644 18193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:11.624684 18193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:11.624711 18193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:11.626070 18193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:11.626312 18193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:11.626577 18193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:11.631367 18201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:11.631363 18204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:11.631390 18193 server_base.cc:1034] running on GCE node
W20260808 17:41:11.631369 18200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:11.631763 18193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:11.631987 18193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:11.633139 18193 hybrid_clock.cc:648] HybridClock initialized: now 1786210871633120 us; error 33 us; skew 500 ppm
I20260808 17:41:11.634452 18193 webserver.cc:460] Webserver started at http://127.9.187.195:35115/ using document root <none> and password file <none>
I20260808 17:41:11.634666 18193 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:11.634712 18193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:11.634841 18193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:11.635908 18193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "a8a5d510e89b44c5b01497fcc71689e3"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "4a78b83ac195bf4f85f84b8f1a94dc33"
server_key_iv: "93d7e99e0fe679bc3f9c619b9b61b43d"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.636250 18193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "a8a5d510e89b44c5b01497fcc71689e3"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "4a78b83ac195bf4f85f84b8f1a94dc33"
server_key_iv: "93d7e99e0fe679bc3f9c619b9b61b43d"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.637447 18193 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:11.638088 18214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.638265 18193 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:11.638346 18193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "a8a5d510e89b44c5b01497fcc71689e3"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "4a78b83ac195bf4f85f84b8f1a94dc33"
server_key_iv: "93d7e99e0fe679bc3f9c619b9b61b43d"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.638417 18193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:11.641606 18193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:11.641839 18193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:11.641952 18193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:11.642172 18193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:11.642468 18193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:11.642500 18193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.642529 18193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:11.642550 18193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.647818 18193 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:38619
I20260808 17:41:11.647858 18403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:38619 every 8 connection(s)
I20260808 17:41:11.648151 18193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:41:11.651049 17717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.648834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:46389 (local address 127.9.187.254:41039)
0808 17:41:11.648884 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.648886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.649077 (+ 191us) server_negotiation.cc:407] Connection header received
0808 17:41:11.649569 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.649571 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.649578 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.649629 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.650805 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.650806 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.650807 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:11.650813 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.650830 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:11.650835 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.650884 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.650961 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.650976 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:41:11.651222 18410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.648803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:41039 (local address 127.9.187.195:46389)
0808 17:41:11.648965 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.648997 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.649465 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.649709 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.649714 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.649724 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:11.650646 (+ 922us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:11.650647 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:11.650676 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:11.650704 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:11.650890 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:11.650895 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:11.650898 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.650969 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.651029 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":66,"threads_started":1}
I20260808 17:41:11.651736 18406 heartbeater.cc:347] Connected to a master server at 127.9.187.254:41039
I20260808 17:41:11.651831 18406 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:11.651978 18406 heartbeater.cc:511] Master 127.9.187.254:41039 requested a full tablet report, sending...
I20260808 17:41:11.652356 17651 ts_manager.cc:194] Registered new tserver with Master: a8a5d510e89b44c5b01497fcc71689e3 (127.9.187.195:38619)
I20260808 17:41:11.658326 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 18193
I20260808 17:41:11.658418 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:11.658560 9967 external_mini_cluster.cc:1428] Setting key 60529210ebbf9565afd261a530bef619
I20260808 17:41:11.659371 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:41:11.661464 17717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.660548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57332 (local address 127.9.187.254:41039)
0808 17:41:11.660587 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.660589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.660732 (+ 143us) server_negotiation.cc:407] Connection header received
0808 17:41:11.660762 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.660762 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.660767 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.660809 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.661288 (+ 479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.661289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.661289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:11.661293 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.661306 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:11.661310 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.661348 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.661384 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.661395 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:41:11.662873 17651 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57332:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:41:11.664299 17651 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:41:11.667794 18423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.666226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:38619 (local address 127.0.0.1:48406)
0808 17:41:11.666390 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.666428 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.666480 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.666848 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.666849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.666852 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:11.667441 (+ 589us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:11.667442 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:11.667448 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:11.667460 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:11.667638 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:11.667646 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:11.667648 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.667711 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.667724 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":4,"thread_start_us":59,"threads_started":1}
I20260808 17:41:11.667939 18421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.666226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:40071 (local address 127.0.0.1:39528)
0808 17:41:11.666389 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.666428 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.666480 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.667275 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.667276 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.667279 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:11.667607 (+ 328us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:11.667608 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:11.667615 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:11.667627 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:11.667810 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:11.667811 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:11.667812 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.667860 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.667873 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":75,"threads_started":1}
I20260808 17:41:11.668083 18425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.666387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48406 (local address 127.9.187.195:38619)
0808 17:41:11.666720 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.666724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.666732 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:11.666752 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.666754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.666760 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.666829 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.667521 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.667528 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.667528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:11.667532 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.667563 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:11.667582 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.667633 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.667978 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.667993 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":79,"threads_started":1}
I20260808 17:41:11.668090 18422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.666241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:43059 (local address 127.0.0.1:48406)
0808 17:41:11.666588 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.666597 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.666635 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.666785 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.666793 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.666799 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:11.667237 (+ 438us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:11.667238 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:11.667255 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:11.667278 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:11.667970 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:11.667971 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:11.667972 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.668011 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.668023 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":104,"threads_started":1}
I20260808 17:41:11.668200 18427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.666547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39528 (local address 127.9.187.194:40071)
0808 17:41:11.667149 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.667152 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.667159 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:41:11.667181 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.667183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.667189 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.667254 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.667691 (+ 437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.667697 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.667698 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:11.667702 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.667731 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:11.667750 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.667803 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.668106 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.668121 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":69,"threads_started":1}
I20260808 17:41:11.668319 18426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.666483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48406 (local address 127.9.187.193:43059)
0808 17:41:11.666660 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.666664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.666674 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:11.666699 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.666701 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.666710 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.666776 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.667842 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.667846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.667846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:11.667850 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.667879 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:11.667893 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.667945 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.668226 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.668242 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
I20260808 17:41:11.668931 18073 tablet_service.cc:1467] Processing CreateTablet for tablet a3bbee2669d74351b584674ba012ee38 (DEFAULT_TABLE table=test-table [id=da286ff3814a4435925ca6976bbd46f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:11.668931 18305 tablet_service.cc:1467] Processing CreateTablet for tablet a3bbee2669d74351b584674ba012ee38 (DEFAULT_TABLE table=test-table [id=da286ff3814a4435925ca6976bbd46f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:11.669298 18073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3bbee2669d74351b584674ba012ee38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:11.669298 18305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3bbee2669d74351b584674ba012ee38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:11.670501 17862 tablet_service.cc:1467] Processing CreateTablet for tablet a3bbee2669d74351b584674ba012ee38 (DEFAULT_TABLE table=test-table [id=da286ff3814a4435925ca6976bbd46f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:11.670799 17862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3bbee2669d74351b584674ba012ee38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:11.672675 18429 tablet_bootstrap.cc:492] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3: Bootstrap starting.
I20260808 17:41:11.673327 18429 tablet_bootstrap.cc:654] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:11.673655 18429 log.cc:824] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:11.673646 18430 tablet_bootstrap.cc:492] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2: Bootstrap starting.
I20260808 17:41:11.673974 18428 tablet_bootstrap.cc:492] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: Bootstrap starting.
I20260808 17:41:11.674247 18430 tablet_bootstrap.cc:654] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:11.674427 18429 tablet_bootstrap.cc:492] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3: No bootstrap required, opened a new log
I20260808 17:41:11.674492 18429 ts_tablet_manager.cc:1397] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:11.674546 18430 log.cc:824] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:11.674813 18428 tablet_bootstrap.cc:654] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:11.675113 18428 log.cc:824] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:11.675209 18430 tablet_bootstrap.cc:492] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2: No bootstrap required, opened a new log
I20260808 17:41:11.675277 18430 ts_tablet_manager.cc:1397] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 17:41:11.675892 18428 tablet_bootstrap.cc:492] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: No bootstrap required, opened a new log
I20260808 17:41:11.675964 18428 ts_tablet_manager.cc:1397] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:11.676877 18429 raft_consensus.cc:348] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8a5d510e89b44c5b01497fcc71689e3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38619 } } peers { permanent_uuid: "331099999aaf4a3eaaa7f367589757e0" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 40071 } } peers { permanent_uuid: "03f650dd76ce4a858b2386e0b43348f2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 43059 } }
I20260808 17:41:11.677053 18429 raft_consensus.cc:374] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:11.677098 18429 raft_consensus.cc:729] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8a5d510e89b44c5b01497fcc71689e3, State: Initialized, Role: FOLLOWER
I20260808 17:41:11.677130 18430 raft_consensus.cc:348] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8a5d510e89b44c5b01497fcc71689e3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38619 } } peers { permanent_uuid: "331099999aaf4a3eaaa7f367589757e0" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 40071 } } peers { permanent_uuid: "03f650dd76ce4a858b2386e0b43348f2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 43059 } }
I20260808 17:41:11.677209 18429 consensus_queue.cc:260] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8a5d510e89b44c5b01497fcc71689e3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38619 } } peers { permanent_uuid: "331099999aaf4a3eaaa7f367589757e0" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 40071 } } peers { permanent_uuid: "03f650dd76ce4a858b2386e0b43348f2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 43059 } }
I20260808 17:41:11.677274 18430 raft_consensus.cc:374] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:11.677315 18430 raft_consensus.cc:729] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f650dd76ce4a858b2386e0b43348f2, State: Initialized, Role: FOLLOWER
I20260808 17:41:11.677455 18429 ts_tablet_manager.cc:1428] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 17:41:11.677434 18430 consensus_queue.cc:260] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8a5d510e89b44c5b01497fcc71689e3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38619 } } peers { permanent_uuid: "331099999aaf4a3eaaa7f367589757e0" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 40071 } } peers { permanent_uuid: "03f650dd76ce4a858b2386e0b43348f2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 43059 } }
I20260808 17:41:11.677636 18406 heartbeater.cc:503] Master 127.9.187.254:41039 was elected leader, sending a full tablet report...
I20260808 17:41:11.677692 18430 ts_tablet_manager.cc:1428] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 17:41:11.677821 17973 heartbeater.cc:503] Master 127.9.187.254:41039 was elected leader, sending a full tablet report...
I20260808 17:41:11.678817 18428 raft_consensus.cc:348] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8a5d510e89b44c5b01497fcc71689e3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38619 } } peers { permanent_uuid: "331099999aaf4a3eaaa7f367589757e0" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 40071 } } peers { permanent_uuid: "03f650dd76ce4a858b2386e0b43348f2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 43059 } }
I20260808 17:41:11.678957 18428 raft_consensus.cc:374] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:11.678982 18428 raft_consensus.cc:729] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 331099999aaf4a3eaaa7f367589757e0, State: Initialized, Role: FOLLOWER
I20260808 17:41:11.679059 18428 consensus_queue.cc:260] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8a5d510e89b44c5b01497fcc71689e3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38619 } } peers { permanent_uuid: "331099999aaf4a3eaaa7f367589757e0" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 40071 } } peers { permanent_uuid: "03f650dd76ce4a858b2386e0b43348f2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 43059 } }
I20260808 17:41:11.679236 18428 ts_tablet_manager.cc:1428] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:41:11.679296 18190 heartbeater.cc:503] Master 127.9.187.254:41039 was elected leader, sending a full tablet report...
W20260808 17:41:11.683395 17974 tablet.cc:2369] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:41:11.789347 18436 raft_consensus.cc:482] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:11.789467 18436 raft_consensus.cc:504] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8a5d510e89b44c5b01497fcc71689e3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38619 } } peers { permanent_uuid: "331099999aaf4a3eaaa7f367589757e0" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 40071 } } peers { permanent_uuid: "03f650dd76ce4a858b2386e0b43348f2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 43059 } }
I20260808 17:41:11.789868 18436 leader_election.cc:288] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 331099999aaf4a3eaaa7f367589757e0 (127.9.187.194:40071), 03f650dd76ce4a858b2386e0b43348f2 (127.9.187.193:43059)
I20260808 17:41:11.791085 18410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.790030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:40071 (local address 127.9.187.195:55631)
0808 17:41:11.790081 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.790093 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.790197 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.790366 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.790367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.790370 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:11.790785 (+ 415us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:11.790786 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:11.790793 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:11.790804 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:11.790967 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:11.790968 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:11.790969 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.791009 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.791020 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 17:41:11.791112 18427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.790209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:55631 (local address 127.9.187.194:40071)
0808 17:41:11.790257 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.790258 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.790267 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:11.790292 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.790293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.790298 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.790349 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.790884 (+ 535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.790886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.790886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:11.790891 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.790909 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:11.790913 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.790964 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.791012 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.791026 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:41:11.791180 18426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.790113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:47387 (local address 127.9.187.193:43059)
0808 17:41:11.790185 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.790188 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.790364 (+ 176us) server_negotiation.cc:407] Connection header received
0808 17:41:11.790396 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.790397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.790402 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.790444 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.790982 (+ 538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.790983 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.790984 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:11.790988 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.791006 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:11.791010 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.791062 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.791108 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.791121 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 17:41:11.791358 18439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.790040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:43059 (local address 127.9.187.195:47387)
0808 17:41:11.790298 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.790306 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:11.790353 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:11.790472 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:11.790473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:11.790475 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:11.790897 (+ 422us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:11.790897 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:11.790902 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:11.790911 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:11.791065 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:11.791065 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:11.791066 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:41:11.791107 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 17:41:11.791118 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":60,"thread_start_us":124,"threads_started":1}
I20260808 17:41:11.791487 18110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bbee2669d74351b584674ba012ee38" candidate_uuid: "a8a5d510e89b44c5b01497fcc71689e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "331099999aaf4a3eaaa7f367589757e0" is_pre_election: true
I20260808 17:41:11.791636 18110 raft_consensus.cc:2454] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8a5d510e89b44c5b01497fcc71689e3 in term 0.
W20260808 17:41:11.791785 18191 tablet.cc:2369] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:41:11.791778 17898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bbee2669d74351b584674ba012ee38" candidate_uuid: "a8a5d510e89b44c5b01497fcc71689e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f650dd76ce4a858b2386e0b43348f2" is_pre_election: true
I20260808 17:41:11.791891 18217 leader_election.cc:302] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 331099999aaf4a3eaaa7f367589757e0, a8a5d510e89b44c5b01497fcc71689e3; no voters:
I20260808 17:41:11.791919 17898 raft_consensus.cc:2454] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8a5d510e89b44c5b01497fcc71689e3 in term 0.
I20260808 17:41:11.791999 18436 raft_consensus.cc:2781] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:41:11.792058 18436 raft_consensus.cc:482] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:11.792081 18436 raft_consensus.cc:3037] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:11.792784 18436 raft_consensus.cc:504] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8a5d510e89b44c5b01497fcc71689e3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38619 } } peers { permanent_uuid: "331099999aaf4a3eaaa7f367589757e0" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 40071 } } peers { permanent_uuid: "03f650dd76ce4a858b2386e0b43348f2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 43059 } }
I20260808 17:41:11.792904 18436 leader_election.cc:288] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [CANDIDATE]: Term 1 election: Requested vote from peers 331099999aaf4a3eaaa7f367589757e0 (127.9.187.194:40071), 03f650dd76ce4a858b2386e0b43348f2 (127.9.187.193:43059)
I20260808 17:41:11.793076 18110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bbee2669d74351b584674ba012ee38" candidate_uuid: "a8a5d510e89b44c5b01497fcc71689e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "331099999aaf4a3eaaa7f367589757e0"
I20260808 17:41:11.793159 18110 raft_consensus.cc:3037] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:11.793164 17898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bbee2669d74351b584674ba012ee38" candidate_uuid: "a8a5d510e89b44c5b01497fcc71689e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f650dd76ce4a858b2386e0b43348f2"
I20260808 17:41:11.793249 17898 raft_consensus.cc:3037] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:11.793922 18110 raft_consensus.cc:2454] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8a5d510e89b44c5b01497fcc71689e3 in term 1.
I20260808 17:41:11.793958 17898 raft_consensus.cc:2454] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8a5d510e89b44c5b01497fcc71689e3 in term 1.
I20260808 17:41:11.794091 18217 leader_election.cc:302] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 331099999aaf4a3eaaa7f367589757e0, a8a5d510e89b44c5b01497fcc71689e3; no voters:
I20260808 17:41:11.794262 18436 raft_consensus.cc:2781] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:11.794413 18436 raft_consensus.cc:686] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 1 LEADER]: Becoming Leader. State: Replica: a8a5d510e89b44c5b01497fcc71689e3, State: Running, Role: LEADER
I20260808 17:41:11.794503 18436 consensus_queue.cc:237] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8a5d510e89b44c5b01497fcc71689e3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38619 } } peers { permanent_uuid: "331099999aaf4a3eaaa7f367589757e0" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 40071 } } peers { permanent_uuid: "03f650dd76ce4a858b2386e0b43348f2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 43059 } }
I20260808 17:41:11.795264 17650 catalog_manager.cc:5495] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8a5d510e89b44c5b01497fcc71689e3 (127.9.187.195). New cstate: current_term: 1 leader_uuid: "a8a5d510e89b44c5b01497fcc71689e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8a5d510e89b44c5b01497fcc71689e3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "331099999aaf4a3eaaa7f367589757e0" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f650dd76ce4a858b2386e0b43348f2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 43059 } health_report { overall_health: UNKNOWN } } }
I20260808 17:41:11.811856 18425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.811065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48410 (local address 127.9.187.195:38619)
0808 17:41:11.811115 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:11.811116 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:11.811124 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:11.811184 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:11.811185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:11.811194 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:11.811245 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:11.811702 (+ 457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:11.811703 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:11.811703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:11.811705 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:11.811713 (+ 8us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:11.811716 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:11.811756 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:11.811788 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 17:41:11.811797 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:41:11.813339 17898 raft_consensus.cc:1261] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2 [term 1 FOLLOWER]: Refusing update from remote peer a8a5d510e89b44c5b01497fcc71689e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:11.813339 18110 raft_consensus.cc:1261] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0 [term 1 FOLLOWER]: Refusing update from remote peer a8a5d510e89b44c5b01497fcc71689e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:11.813638 18440 consensus_queue.cc:1035] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f650dd76ce4a858b2386e0b43348f2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 43059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:11.813751 18436 consensus_queue.cc:1035] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "331099999aaf4a3eaaa7f367589757e0" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:11.818750 17651 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57332:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:11.818862 17651 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57332:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:11.819512 17651 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5990e86197184ecba3125711a32a4ff7: Sending DeleteTablet for 3 replicas of tablet a3bbee2669d74351b584674ba012ee38
I20260808 17:41:11.819792 18305 tablet_service.cc:1514] Processing DeleteTablet for tablet a3bbee2669d74351b584674ba012ee38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:11 UTC) from {username='slave'} at 127.0.0.1:48406
I20260808 17:41:11.819829 17862 tablet_service.cc:1514] Processing DeleteTablet for tablet a3bbee2669d74351b584674ba012ee38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:11 UTC) from {username='slave'} at 127.0.0.1:48406
I20260808 17:41:11.819834 18073 tablet_service.cc:1514] Processing DeleteTablet for tablet a3bbee2669d74351b584674ba012ee38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:11 UTC) from {username='slave'} at 127.0.0.1:39528
I20260808 17:41:11.820052 18464 tablet_replica.cc:330] T a3bbee2669d74351b584674ba012ee38 P 03f650dd76ce4a858b2386e0b43348f2: stopping tablet replica
I20260808 17:41:11.820292 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 17757
I20260808 17:41:11.828186 18468 tablet_replica.cc:330] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: stopping tablet replica
I20260808 17:41:11.828291 18468 raft_consensus.cc:2229] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:11.828385 18468 raft_consensus.cc:2258] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:11.828838 18468 ts_tablet_manager.cc:1905] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:11.830427 18468 ts_tablet_manager.cc:1918] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:11.830492 18468 log.cc:1196] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/a3bbee2669d74351b584674ba012ee38
I20260808 17:41:11.830739 18468 ts_tablet_manager.cc:1939] T a3bbee2669d74351b584674ba012ee38 P 331099999aaf4a3eaaa7f367589757e0: Deleting consensus metadata
I20260808 17:41:11.830904 18466 tablet_replica.cc:330] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3: stopping tablet replica
I20260808 17:41:11.830993 18466 raft_consensus.cc:2229] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:41:11.831128 18466 raft_consensus.cc:2258] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:11.831419 17622 catalog_manager.cc:4841] TS 331099999aaf4a3eaaa7f367589757e0 (127.9.187.194:40071): tablet a3bbee2669d74351b584674ba012ee38 (table test-table [id=da286ff3814a4435925ca6976bbd46f4]) successfully deleted
I20260808 17:41:11.834676 18466 ts_tablet_manager.cc:1905] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 17:41:11.835107 17624 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:43059 (error 108)
I20260808 17:41:11.835395 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 17978
I20260808 17:41:11.836211 18466 ts_tablet_manager.cc:1918] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:11.836269 18466 log.cc:1196] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/a3bbee2669d74351b584674ba012ee38
I20260808 17:41:11.836472 18466 ts_tablet_manager.cc:1939] T a3bbee2669d74351b584674ba012ee38 P a8a5d510e89b44c5b01497fcc71689e3: Deleting consensus metadata
I20260808 17:41:11.847092 18422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:11.846935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:43059 (local address 127.0.0.1:48422)
0808 17:41:11.846994 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:11.847051 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:43059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 17:41:11.847298 17624 catalog_manager.cc:4584] TS 03f650dd76ce4a858b2386e0b43348f2 (127.9.187.193:43059): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a3bbee2669d74351b584674ba012ee38: Network error: Client connection negotiation failed: client connection to 127.9.187.193:43059: connect: Connection refused (error 111)
I20260808 17:41:11.847589 17621 catalog_manager.cc:4841] TS a8a5d510e89b44c5b01497fcc71689e3 (127.9.187.195:38619): tablet a3bbee2669d74351b584674ba012ee38 (table test-table [id=da286ff3814a4435925ca6976bbd46f4]) successfully deleted
I20260808 17:41:11.855262 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 18193
I20260808 17:41:11.864547 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 17594
2026-08-08T17:41:11Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (710 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 17:41:11.889731 9967 mini_oidc.cc:152] Starting JWKS server
I20260808 17:41:11.891024 9967 webserver.cc:460] Webserver started at https://127.0.0.1:43009/ using document root <none> and password file <none>
I20260808 17:41:11.891106 9967 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 17:41:11.891289 9967 webserver.cc:460] Webserver started at http://127.0.0.1:41139/ using document root <none> and password file <none>
2026-08-08T17:41:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:11Z Disabled control of system clock
I20260808 17:41:11.899771 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41577
--webserver_interface=127.9.187.254
--webserver_port=0
--builtin_ntp_servers=127.9.187.212:38703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:41577
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43009/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/testchainca.cert with env {}
W20260808 17:41:11.980319 18477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:11.980527 18477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:11.980548 18477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:11.981673 18477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:11.981707 18477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:11.981719 18477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:11.981729 18477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:11.981740 18477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 17:41:11.981750 18477 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 17:41:11.981760 18477 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43009/jwks.json
I20260808 17:41:11.983219 18477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:41577
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43009/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:11.983433 18477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:11.983651 18477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:11.988284 18484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:11.988303 18482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:11.988370 18477 server_base.cc:1034] running on GCE node
W20260808 17:41:11.988287 18488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:11.988721 18477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:11.988991 18477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:11.990168 18477 hybrid_clock.cc:648] HybridClock initialized: now 1786210871990150 us; error 28 us; skew 500 ppm
I20260808 17:41:11.991406 18477 webserver.cc:460] Webserver started at http://127.9.187.254:35711/ using document root <none> and password file <none>
I20260808 17:41:11.991626 18477 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:11.991678 18477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:11.991801 18477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:11.992803 18477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "af6d6a7ab7bd44c6a25d3627c42f15fb"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "dd0a97ea866316bb2dd267d34196ef62"
server_key_iv: "3ad2286ff8bb83bd371d6391cd2192df"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.993139 18477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "af6d6a7ab7bd44c6a25d3627c42f15fb"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "dd0a97ea866316bb2dd267d34196ef62"
server_key_iv: "3ad2286ff8bb83bd371d6391cd2192df"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.994354 18477 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:11.994997 18497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:11.995144 18477 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:11.995232 18477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "af6d6a7ab7bd44c6a25d3627c42f15fb"
format_stamp: "Formatted at 2026-08-08 17:41:11 on dist-test-slave-bqcl"
server_key: "dd0a97ea866316bb2dd267d34196ef62"
server_key_iv: "3ad2286ff8bb83bd371d6391cd2192df"
server_key_version: "encryptionkey@0"
I20260808 17:41:11.995288 18477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:12.031908 18477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:12.032234 18477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:12.032368 18477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:12.036171 18477 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:41577
I20260808 17:41:12.036206 18582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:41577 every 8 connection(s)
I20260808 17:41:12.036517 18477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:12.037549 18584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:12.039847 18584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb: Bootstrap starting.
I20260808 17:41:12.040426 18584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:12.040709 18584 log.cc:824] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:12.041383 18584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb: No bootstrap required, opened a new log
I20260808 17:41:12.042990 18584 raft_consensus.cc:348] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6d6a7ab7bd44c6a25d3627c42f15fb" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41577 } }
I20260808 17:41:12.043128 18584 raft_consensus.cc:374] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:12.043148 18584 raft_consensus.cc:729] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6d6a7ab7bd44c6a25d3627c42f15fb, State: Initialized, Role: FOLLOWER
I20260808 17:41:12.043294 18584 consensus_queue.cc:260] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6d6a7ab7bd44c6a25d3627c42f15fb" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41577 } }
I20260808 17:41:12.043356 18584 raft_consensus.cc:388] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:12.043376 18584 raft_consensus.cc:482] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:12.043421 18584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:12.043887 18584 raft_consensus.cc:504] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6d6a7ab7bd44c6a25d3627c42f15fb" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41577 } }
I20260808 17:41:12.043995 18584 leader_election.cc:302] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af6d6a7ab7bd44c6a25d3627c42f15fb; no voters:
I20260808 17:41:12.044093 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 18477
I20260808 17:41:12.044157 18584 leader_election.cc:288] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:12.044203 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:12.044199 18588 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:12.044320 18588 raft_consensus.cc:686] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [term 1 LEADER]: Becoming Leader. State: Replica: af6d6a7ab7bd44c6a25d3627c42f15fb, State: Running, Role: LEADER
I20260808 17:41:12.044418 9967 external_mini_cluster.cc:1428] Setting key f720bdc0ac493c9107f84df96bbcc548
I20260808 17:41:12.044420 18584 sys_catalog.cc:564] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:12.044420 18588 consensus_queue.cc:237] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6d6a7ab7bd44c6a25d3627c42f15fb" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41577 } }
I20260808 17:41:12.044973 18591 sys_catalog.cc:455] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader af6d6a7ab7bd44c6a25d3627c42f15fb. Latest consensus state: current_term: 1 leader_uuid: "af6d6a7ab7bd44c6a25d3627c42f15fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6d6a7ab7bd44c6a25d3627c42f15fb" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41577 } } }
I20260808 17:41:12.045156 18591 sys_catalog.cc:458] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:12.045384 18592 sys_catalog.cc:455] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af6d6a7ab7bd44c6a25d3627c42f15fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6d6a7ab7bd44c6a25d3627c42f15fb" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41577 } } }
I20260808 17:41:12.045596 18592 sys_catalog.cc:458] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:12.045771 18611 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:12.046293 18611 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:12.047899 18611 catalog_manager.cc:1347] Generated new cluster ID: 2f2a868db2e741989d45c7a8af178241
I20260808 17:41:12.047957 18611 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:12.051054 18598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:12.044900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52140 (local address 127.9.187.254:41577)
0808 17:41:12.045156 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:12.045165 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:12.045392 (+ 227us) server_negotiation.cc:407] Connection header received
0808 17:41:12.045649 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:12.045656 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:12.045727 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:12.045860 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:12.046266 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.047629 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.048745 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.049380 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.049505 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.050218 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:12.050222 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:12.050222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:12.050445 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:12.050489 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:12.050503 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:12.050569 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:12.050644 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 17:41:12.050826 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":97,"threads_started":1}
I20260808 17:41:12.051985 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:41:12.060184 18611 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:12.060683 18611 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:12.065351 18611 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af6d6a7ab7bd44c6a25d3627c42f15fb: Generated new TSK 0
I20260808 17:41:12.065512 18611 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 17:41:12.088626 18631 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 17:41:12.088774 18631 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260808 17:41:12.089253 18630 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:12.074002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:41577 (local address 127.0.0.1:52152)
0808 17:41:12.074218 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:12.074228 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:12.074300 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:12.074484 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:12.074485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:12.074487 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 17:41:12.074561 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:12.074564 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.075203 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.075204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:12.075819 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:12.075821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.076184 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.076185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:12.076258 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.076280 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 17:41:12.088863 (+ 12583us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 17:41:12.088955 (+ 92us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.187.254:41577: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":93,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.9.187.254:41577: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 17:41:12.089672 18598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:12.074091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52152 (local address 127.9.187.254:41577)
0808 17:41:12.074151 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:12.074153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:12.074291 (+ 138us) server_negotiation.cc:407] Connection header received
0808 17:41:12.074395 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:12.074395 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:12.074408 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:12.074476 (+ 68us) server_negotiation.cc:226] Negotiated authn=JWT
0808 17:41:12.074631 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.075125 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.075909 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.076107 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.076162 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.076384 (+ 222us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 17:41:12.088706 (+ 12322us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 17:41:12.089479 (+ 773us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52152: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:41:12.089697 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 18477
W20260808 17:41:12.089731 18598 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52152: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
2026-08-08T17:41:12Z chronyd exiting
I20260808 17:41:12.145272 9967 test_util.cc:175] -----------------------------------------------
I20260808 17:41:12.145357 9967 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786210848752357-9967-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (256 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 17:41:12.146248 9967 mini_oidc.cc:152] Starting JWKS server
I20260808 17:41:12.146993 9967 webserver.cc:460] Webserver started at https://127.0.0.1:34063/ using document root <none> and password file <none>
I20260808 17:41:12.147042 9967 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 17:41:12.147208 9967 webserver.cc:460] Webserver started at http://127.0.0.1:39969/ using document root <none> and password file <none>
2026-08-08T17:41:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:12Z Disabled control of system clock
I20260808 17:41:12.155629 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41249
--webserver_interface=127.9.187.254
--webserver_port=0
--builtin_ntp_servers=127.9.187.212:34907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:41249
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34063/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/testchainca.cert with env {}
W20260808 17:41:12.235430 18643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:12.235633 18643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:12.235653 18643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:12.236752 18643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:12.236788 18643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:12.236799 18643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:12.236809 18643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:12.236824 18643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 17:41:12.236835 18643 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 17:41:12.236847 18643 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34063/jwks.json
I20260808 17:41:12.238350 18643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:34907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:41249
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34063/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:12.238559 18643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:12.238724 18643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:12.243251 18653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:12.243273 18651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:12.243285 18643 server_base.cc:1034] running on GCE node
W20260808 17:41:12.243258 18650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:12.243721 18643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:12.244014 18643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:12.245162 18643 hybrid_clock.cc:648] HybridClock initialized: now 1786210872245141 us; error 34 us; skew 500 ppm
I20260808 17:41:12.246387 18643 webserver.cc:460] Webserver started at http://127.9.187.254:46263/ using document root <none> and password file <none>
I20260808 17:41:12.246609 18643 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:12.246660 18643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:12.246783 18643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:12.247799 18643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "37b3c498e86547e3866fc06f0d829b6b"
format_stamp: "Formatted at 2026-08-08 17:41:12 on dist-test-slave-bqcl"
server_key: "9d1009532b4aa2e86da1a56910fb1f9f"
server_key_iv: "d578a6ed069ce53c36c77cd0246f8db5"
server_key_version: "encryptionkey@0"
I20260808 17:41:12.248128 18643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "37b3c498e86547e3866fc06f0d829b6b"
format_stamp: "Formatted at 2026-08-08 17:41:12 on dist-test-slave-bqcl"
server_key: "9d1009532b4aa2e86da1a56910fb1f9f"
server_key_iv: "d578a6ed069ce53c36c77cd0246f8db5"
server_key_version: "encryptionkey@0"
I20260808 17:41:12.249300 18643 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:12.249986 18662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:12.250159 18643 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:12.250248 18643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "37b3c498e86547e3866fc06f0d829b6b"
format_stamp: "Formatted at 2026-08-08 17:41:12 on dist-test-slave-bqcl"
server_key: "9d1009532b4aa2e86da1a56910fb1f9f"
server_key_iv: "d578a6ed069ce53c36c77cd0246f8db5"
server_key_version: "encryptionkey@0"
I20260808 17:41:12.250314 18643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:12.266014 18643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:12.266324 18643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:12.266453 18643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:12.270164 18643 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:41249
I20260808 17:41:12.270185 18747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:41249 every 8 connection(s)
I20260808 17:41:12.270506 18643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:12.271423 18749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:12.273707 18749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b: Bootstrap starting.
I20260808 17:41:12.274363 18749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:12.274667 18749 log.cc:824] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:12.275431 18749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b: No bootstrap required, opened a new log
I20260808 17:41:12.276983 18749 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b3c498e86547e3866fc06f0d829b6b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41249 } }
I20260808 17:41:12.277119 18749 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:12.277153 18749 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b3c498e86547e3866fc06f0d829b6b, State: Initialized, Role: FOLLOWER
I20260808 17:41:12.277292 18749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b3c498e86547e3866fc06f0d829b6b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41249 } }
I20260808 17:41:12.277355 18749 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:12.277384 18749 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:12.277431 18749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:12.277925 18749 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b3c498e86547e3866fc06f0d829b6b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41249 } }
I20260808 17:41:12.278020 18749 leader_election.cc:302] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37b3c498e86547e3866fc06f0d829b6b; no voters:
I20260808 17:41:12.278195 18749 leader_election.cc:288] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:12.278244 18753 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:12.278402 18753 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [term 1 LEADER]: Becoming Leader. State: Replica: 37b3c498e86547e3866fc06f0d829b6b, State: Running, Role: LEADER
I20260808 17:41:12.278448 18749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:12.278509 18753 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b3c498e86547e3866fc06f0d829b6b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41249 } }
I20260808 17:41:12.279054 18755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37b3c498e86547e3866fc06f0d829b6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b3c498e86547e3866fc06f0d829b6b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41249 } } }
I20260808 17:41:12.279137 18755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:12.279312 18756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37b3c498e86547e3866fc06f0d829b6b. Latest consensus state: current_term: 1 leader_uuid: "37b3c498e86547e3866fc06f0d829b6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b3c498e86547e3866fc06f0d829b6b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41249 } } }
I20260808 17:41:12.279373 18756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:12.279487 18767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:12.279939 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 18643
I20260808 17:41:12.279971 18767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:12.280051 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:12.280251 9967 external_mini_cluster.cc:1428] Setting key b73a2379016088c2478b8f433ad135b5
I20260808 17:41:12.281705 18767 catalog_manager.cc:1347] Generated new cluster ID: 5d7631941a0d4285a9ad08d20745dfe4
I20260808 17:41:12.281755 18767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:12.286406 18778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:12.280844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35382 (local address 127.9.187.254:41249)
0808 17:41:12.281024 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:12.281041 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:12.281073 (+ 32us) server_negotiation.cc:407] Connection header received
0808 17:41:12.281349 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:12.281357 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:12.281431 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:12.281577 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:12.281831 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.283228 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.284289 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.284939 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.285072 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.285692 (+ 620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:12.285696 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:12.285696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:12.285911 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:12.285955 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:12.285969 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:12.286038 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:12.286097 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 17:41:12.286201 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
I20260808 17:41:12.287328 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:41:12.288849 18767 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:12.289320 18767 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:12.292477 18767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37b3c498e86547e3866fc06f0d829b6b: Generated new TSK 0
I20260808 17:41:12.292624 18767 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 17:41:12.311619 18792 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 17:41:12.311681 18792 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 17:41:12.312032 18778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:12.296922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35390 (local address 127.9.187.254:41249)
0808 17:41:12.296956 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:12.296958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:12.297084 (+ 126us) server_negotiation.cc:407] Connection header received
0808 17:41:12.297120 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:12.297121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:12.297135 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:12.297212 (+ 77us) server_negotiation.cc:226] Negotiated authn=JWT
0808 17:41:12.297308 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.298080 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.298846 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.299157 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.299223 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.299409 (+ 186us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 17:41:12.311824 (+ 12415us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34063/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 17:41:12.311962 (+ 138us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35390: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34063/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 17:41:12.312088 18778 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35390: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34063/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 17:41:12.312100 18791 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:12.296873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:41249 (local address 127.0.0.1:35390)
0808 17:41:12.297014 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:12.297024 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:12.297077 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:12.297209 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:12.297210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:12.297211 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0808 17:41:12.297259 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:12.297261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.298189 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.298189 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:12.298776 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:12.298778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.299240 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.299241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:12.299290 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.299294 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 17:41:12.311916 (+ 12622us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34063/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 17:41:12.312021 (+ 105us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.187.254:41249: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34063/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260808 17:41:12.312398 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 18643
2026-08-08T17:41:12Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (221 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 17:41:12.368057 9967 mini_oidc.cc:152] Starting JWKS server
I20260808 17:41:12.368741 9967 webserver.cc:460] Webserver started at https://127.0.0.1:39459/ using document root <none> and password file <none>
I20260808 17:41:12.368786 9967 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 17:41:12.368934 9967 webserver.cc:460] Webserver started at http://127.0.0.1:35145/ using document root <none> and password file <none>
2026-08-08T17:41:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:12Z Disabled control of system clock
I20260808 17:41:12.377390 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:40147
--webserver_interface=127.9.187.254
--webserver_port=0
--builtin_ntp_servers=127.9.187.212:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:40147
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39459/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 17:41:12.456424 18802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:12.456627 18802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:12.456658 18802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:12.457787 18802 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:12.457824 18802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:12.457840 18802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:12.457856 18802 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:12.457870 18802 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 17:41:12.457886 18802 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 17:41:12.457904 18802 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39459/jwks.json
I20260808 17:41:12.459249 18802 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:40147
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:40147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39459/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:12.459487 18802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:12.459758 18802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:12.464367 18812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:12.464355 18814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:12.464401 18802 server_base.cc:1034] running on GCE node
W20260808 17:41:12.464376 18807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:12.464864 18802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:12.465147 18802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:12.466288 18802 hybrid_clock.cc:648] HybridClock initialized: now 1786210872466279 us; error 38 us; skew 500 ppm
I20260808 17:41:12.467485 18802 webserver.cc:460] Webserver started at http://127.9.187.254:40767/ using document root <none> and password file <none>
I20260808 17:41:12.467739 18802 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:12.467787 18802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:12.467912 18802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:12.468989 18802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "8e2b67db6cd440c6a61a931d84a9b8f5"
format_stamp: "Formatted at 2026-08-08 17:41:12 on dist-test-slave-bqcl"
server_key: "c846de9684d4c60c4ae3f08ff1459468"
server_key_iv: "def264e0c6e40a0d709c35509a02a146"
server_key_version: "encryptionkey@0"
I20260808 17:41:12.469317 18802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "8e2b67db6cd440c6a61a931d84a9b8f5"
format_stamp: "Formatted at 2026-08-08 17:41:12 on dist-test-slave-bqcl"
server_key: "c846de9684d4c60c4ae3f08ff1459468"
server_key_iv: "def264e0c6e40a0d709c35509a02a146"
server_key_version: "encryptionkey@0"
I20260808 17:41:12.470554 18802 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:41:12.471190 18826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:12.471326 18802 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:12.471410 18802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "8e2b67db6cd440c6a61a931d84a9b8f5"
format_stamp: "Formatted at 2026-08-08 17:41:12 on dist-test-slave-bqcl"
server_key: "c846de9684d4c60c4ae3f08ff1459468"
server_key_iv: "def264e0c6e40a0d709c35509a02a146"
server_key_version: "encryptionkey@0"
I20260808 17:41:12.471467 18802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:12.480947 18802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:12.481197 18802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:12.481314 18802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:12.485055 18802 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:40147
I20260808 17:41:12.485090 18905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:40147 every 8 connection(s)
I20260808 17:41:12.485395 18802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:12.486047 18906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:12.489073 18906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5: Bootstrap starting.
I20260808 17:41:12.489635 18906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:12.489893 18906 log.cc:824] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:12.490546 18906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5: No bootstrap required, opened a new log
I20260808 17:41:12.491181 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 18802
I20260808 17:41:12.491283 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:12.491429 9967 external_mini_cluster.cc:1428] Setting key e26cf4bcaefeec2660c9daa5db6fbe42
I20260808 17:41:12.492517 18906 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e2b67db6cd440c6a61a931d84a9b8f5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40147 } }
I20260808 17:41:12.492679 18906 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:12.492717 18906 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2b67db6cd440c6a61a931d84a9b8f5, State: Initialized, Role: FOLLOWER
I20260808 17:41:12.492839 18906 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e2b67db6cd440c6a61a931d84a9b8f5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40147 } }
I20260808 17:41:12.492916 18906 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:12.492949 18906 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:12.492991 18906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:12.493651 18906 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e2b67db6cd440c6a61a931d84a9b8f5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40147 } }
I20260808 17:41:12.493764 18906 leader_election.cc:302] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e2b67db6cd440c6a61a931d84a9b8f5; no voters:
I20260808 17:41:12.493914 18906 leader_election.cc:288] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:12.493961 18913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:12.494105 18913 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [term 1 LEADER]: Becoming Leader. State: Replica: 8e2b67db6cd440c6a61a931d84a9b8f5, State: Running, Role: LEADER
I20260808 17:41:12.494180 18906 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:12.494211 18913 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e2b67db6cd440c6a61a931d84a9b8f5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40147 } }
I20260808 17:41:12.494513 18913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e2b67db6cd440c6a61a931d84a9b8f5. Latest consensus state: current_term: 1 leader_uuid: "8e2b67db6cd440c6a61a931d84a9b8f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e2b67db6cd440c6a61a931d84a9b8f5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40147 } } }
I20260808 17:41:12.494586 18913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:12.494735 18914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e2b67db6cd440c6a61a931d84a9b8f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e2b67db6cd440c6a61a931d84a9b8f5" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40147 } } }
I20260808 17:41:12.494791 18914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5 [sys.catalog]: This master's current role is: LEADER
W20260808 17:41:12.495944 18939 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:41:12.495998 18939 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:41:12.496043 18926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:12.496191 18926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:12.497675 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:12.491873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56434 (local address 127.9.187.254:40147)
0808 17:41:12.492078 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:12.492088 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:12.492124 (+ 36us) server_negotiation.cc:407] Connection header received
0808 17:41:12.492482 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:12.492491 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:12.492580 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:12.492728 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:12.492936 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.494707 (+ 1771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.495559 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.496130 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.496241 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.496961 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:12.496965 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:12.496966 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:12.497154 (+ 188us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:12.497195 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:12.497209 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:12.497276 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:12.497366 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 17:41:12.497442 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260808 17:41:12.497705 18926 catalog_manager.cc:1347] Generated new cluster ID: 277baf26ee9f45579bb9882c6bd13057
I20260808 17:41:12.497759 18926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:12.498554 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:41:12.505371 18926 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:12.506024 18926 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:12.512347 18926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e2b67db6cd440c6a61a931d84a9b8f5: Generated new TSK 0
I20260808 17:41:12.512502 18926 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:41:12.521126 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:12.517609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56450 (local address 127.9.187.254:40147)
0808 17:41:12.517666 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:12.517668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:12.517725 (+ 57us) server_negotiation.cc:407] Connection header received
0808 17:41:12.517791 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:12.517792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:12.517804 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:12.517877 (+ 73us) server_negotiation.cc:226] Negotiated authn=JWT
0808 17:41:12.517960 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.518754 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.519499 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.519806 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.519873 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.519983 (+ 110us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 17:41:12.520921 (+ 938us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39459/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 17:41:12.521053 (+ 132us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56450: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39459/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 17:41:12.521183 18912 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56450: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39459/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 17:41:12.523013 18951 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:12.517509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40147 (local address 127.0.0.1:56450)
0808 17:41:12.517675 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:12.517685 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:12.517743 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:12.517874 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:12.517875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:12.517877 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 17:41:12.517922 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:12.517924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.518835 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.518835 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:12.519422 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:12.519423 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.519874 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.519875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:12.519912 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.519916 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 17:41:12.521025 (+ 1109us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39459/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 17:41:12.522920 (+ 1895us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.187.254:40147: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39459/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":1712,"thread_start_us":81,"threads_started":1}
I20260808 17:41:12.523536 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 18802
E20260808 17:41:12.546213 18953 webserver.cc:533] Webserver: sslize failed:
E20260808 17:41:12.546306 18953 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T17:41:12Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (207 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T17:41:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:12Z Disabled control of system clock
I20260808 17:41:12.583587 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46883
--webserver_interface=127.9.187.254
--webserver_port=0
--builtin_ntp_servers=127.9.187.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:46883
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/testchainca.cert with env {}
W20260808 17:41:12.663885 18957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:12.664091 18957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:12.664113 18957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:12.665297 18957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:12.665340 18957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:12.665351 18957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:12.665362 18957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:12.665373 18957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 17:41:12.665383 18957 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 17:41:12.665393 18957 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 17:41:12.666901 18957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:46883
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:12.667135 18957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:12.667340 18957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:12.672034 18974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:12.672041 18957 server_base.cc:1034] running on GCE node
W20260808 17:41:12.672084 18970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:12.672089 18969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:12.672456 18957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:12.672740 18957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:12.673878 18957 hybrid_clock.cc:648] HybridClock initialized: now 1786210872673859 us; error 32 us; skew 500 ppm
I20260808 17:41:12.675086 18957 webserver.cc:460] Webserver started at http://127.9.187.254:38453/ using document root <none> and password file <none>
I20260808 17:41:12.675318 18957 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:12.675369 18957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:12.675489 18957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:12.676487 18957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "6a4fb798c12b4ce49a6859d0f359eb8b"
format_stamp: "Formatted at 2026-08-08 17:41:12 on dist-test-slave-bqcl"
server_key: "52f31146ce3d00f21bbb82a102735a76"
server_key_iv: "1073fa2dbb767daf745ba1086f6acfce"
server_key_version: "encryptionkey@0"
I20260808 17:41:12.676827 18957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "6a4fb798c12b4ce49a6859d0f359eb8b"
format_stamp: "Formatted at 2026-08-08 17:41:12 on dist-test-slave-bqcl"
server_key: "52f31146ce3d00f21bbb82a102735a76"
server_key_iv: "1073fa2dbb767daf745ba1086f6acfce"
server_key_version: "encryptionkey@0"
I20260808 17:41:12.678225 18957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:12.678954 18983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:12.679129 18957 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:41:12.679206 18957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "6a4fb798c12b4ce49a6859d0f359eb8b"
format_stamp: "Formatted at 2026-08-08 17:41:12 on dist-test-slave-bqcl"
server_key: "52f31146ce3d00f21bbb82a102735a76"
server_key_iv: "1073fa2dbb767daf745ba1086f6acfce"
server_key_version: "encryptionkey@0"
I20260808 17:41:12.679273 18957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:12.690850 18957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:12.691157 18957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:12.691289 18957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:12.695346 18957 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:46883
I20260808 17:41:12.695380 19070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:46883 every 8 connection(s)
I20260808 17:41:12.695709 18957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:12.696894 19071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:12.697736 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 18957
I20260808 17:41:12.697839 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:12.698035 9967 external_mini_cluster.cc:1428] Setting key 78d93b6ce4172ad83191a88b2859705c
I20260808 17:41:12.700243 19071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b: Bootstrap starting.
I20260808 17:41:12.700973 19071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:12.701324 19071 log.cc:824] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:12.702486 19071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b: No bootstrap required, opened a new log
I20260808 17:41:12.705029 19071 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4fb798c12b4ce49a6859d0f359eb8b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46883 } }
I20260808 17:41:12.705170 19071 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:12.705202 19071 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a4fb798c12b4ce49a6859d0f359eb8b, State: Initialized, Role: FOLLOWER
I20260808 17:41:12.705338 19071 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4fb798c12b4ce49a6859d0f359eb8b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46883 } }
I20260808 17:41:12.705415 19071 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:12.705706 19071 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:12.705780 19071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:12.706373 19071 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4fb798c12b4ce49a6859d0f359eb8b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46883 } }
I20260808 17:41:12.706487 19071 leader_election.cc:302] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a4fb798c12b4ce49a6859d0f359eb8b; no voters:
I20260808 17:41:12.706504 19075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:12.700213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49008 (local address 127.9.187.254:46883)
0808 17:41:12.700436 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:12.700445 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:12.700474 (+ 29us) server_negotiation.cc:407] Connection header received
0808 17:41:12.701045 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:12.701056 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:12.701148 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:12.701305 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:12.701680 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.703021 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.704202 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.704876 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.705003 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.705869 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:12.705873 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:12.705873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:12.706039 (+ 166us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:12.706077 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:12.706088 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:12.706163 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:12.706251 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 17:41:12.706333 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":78,"threads_started":1}
I20260808 17:41:12.706663 19071 leader_election.cc:288] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:12.706691 19078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:12.706809 19078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [term 1 LEADER]: Becoming Leader. State: Replica: 6a4fb798c12b4ce49a6859d0f359eb8b, State: Running, Role: LEADER
I20260808 17:41:12.706897 19078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4fb798c12b4ce49a6859d0f359eb8b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46883 } }
I20260808 17:41:12.707079 19071 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:12.707224 19078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a4fb798c12b4ce49a6859d0f359eb8b. Latest consensus state: current_term: 1 leader_uuid: "6a4fb798c12b4ce49a6859d0f359eb8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4fb798c12b4ce49a6859d0f359eb8b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46883 } } }
I20260808 17:41:12.707284 19080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a4fb798c12b4ce49a6859d0f359eb8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4fb798c12b4ce49a6859d0f359eb8b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46883 } } }
I20260808 17:41:12.707469 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:41:12.707485 19080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:12.707309 19078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:12.708336 19091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:12.708811 19091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:12.710242 19091 catalog_manager.cc:1347] Generated new cluster ID: 65bf75eedd6c4fb1afce6e1cfe611ca9
I20260808 17:41:12.710295 19091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:12.721153 19091 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:12.721668 19091 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:12.724419 19091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a4fb798c12b4ce49a6859d0f359eb8b: Generated new TSK 0
I20260808 17:41:12.724576 19091 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:41:12.783493 19075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:12.732748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49016 (local address 127.9.187.254:46883)
0808 17:41:12.732801 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:12.732804 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:12.732899 (+ 95us) server_negotiation.cc:407] Connection header received
0808 17:41:12.732978 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:12.732979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:12.732988 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:12.733045 (+ 57us) server_negotiation.cc:226] Negotiated authn=JWT
0808 17:41:12.733173 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.733656 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.734792 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.734983 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.735026 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.735199 (+ 173us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 17:41:12.783278 (+ 48079us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 17:41:12.783429 (+ 151us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49016: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 17:41:12.783563 19075 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49016: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 17:41:12.783710 19124 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:12.732699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46883 (local address 127.0.0.1:49016)
0808 17:41:12.732835 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:12.732846 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:12.732912 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:12.733056 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:12.733056 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:12.733058 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 17:41:12.733122 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:12.733124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.733717 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.733717 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:12.734714 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:12.734718 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:12.735050 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:12.735051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:12.735113 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:12.735119 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 17:41:12.783427 (+ 48308us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 17:41:12.783591 (+ 164us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.187.254:46883: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":82,"threads_started":1}
I20260808 17:41:12.784014 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 18957
2026-08-08T17:41:12Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (234 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (91 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (89 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:13 dist-test-slave-bqcl krb5kdc[19146](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:13 dist-test-slave-bqcl krb5kdc[19146](info): set up 2 sockets
Aug 08 17:41:13 dist-test-slave-bqcl krb5kdc[19146](info): commencing operation
krb5kdc: starting...
W20260808 17:41:14.114969 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:41:14.234010 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33903
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:33903
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:14.315054 19172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:14.315254 19172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:14.315285 19172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:14.316413 19172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:14.316455 19172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:14.316473 19172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:14.316489 19172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:14.316505 19172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:14.317950 19172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:33903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:14.318222 19172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:14.318429 19172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:14.323158 19179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:14.323171 19180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:14.323171 19188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:14.323364 19172 server_base.cc:1034] running on GCE node
I20260808 17:41:14.323670 19172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:14.323966 19172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:14.325116 19172 hybrid_clock.cc:648] HybridClock initialized: now 1786210874325099 us; error 29 us; skew 500 ppm
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:14.330201 19172 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:41:14.330695 19172 webserver.cc:460] Webserver started at http://127.9.187.254:44815/ using document root <none> and password file <none>
I20260808 17:41:14.330929 19172 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:14.330979 19172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:14.331106 19172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:14.332144 19172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "453e7448ee8f45668370d76a603e5481"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "d34b0c78fbca2cfbe5f2edeb27c944fb"
server_key_iv: "84b2d08d754f6934127c2a06e63cc9d7"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.332486 19172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "453e7448ee8f45668370d76a603e5481"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "d34b0c78fbca2cfbe5f2edeb27c944fb"
server_key_iv: "84b2d08d754f6934127c2a06e63cc9d7"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.333775 19172 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:14.334559 19197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:14.334712 19172 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:14.334800 19172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "453e7448ee8f45668370d76a603e5481"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "d34b0c78fbca2cfbe5f2edeb27c944fb"
server_key_iv: "84b2d08d754f6934127c2a06e63cc9d7"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.334860 19172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:14.373724 19172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:14.375886 19172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:14.376055 19172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:14.380415 19172 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:33903
I20260808 17:41:14.380460 19287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:33903 every 8 connection(s)
I20260808 17:41:14.380827 19172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:14.381728 19288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:14.384141 19288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481: Bootstrap starting.
I20260808 17:41:14.384699 19288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:14.384964 19288 log.cc:824] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:14.385649 19288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481: No bootstrap required, opened a new log
I20260808 17:41:14.387284 19288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "453e7448ee8f45668370d76a603e5481" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33903 } }
I20260808 17:41:14.387427 19288 raft_consensus.cc:374] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:14.387449 19288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 453e7448ee8f45668370d76a603e5481, State: Initialized, Role: FOLLOWER
I20260808 17:41:14.387560 19288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "453e7448ee8f45668370d76a603e5481" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33903 } }
I20260808 17:41:14.387610 19288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:14.387635 19288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:14.387665 19288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:14.388128 19288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "453e7448ee8f45668370d76a603e5481" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33903 } }
I20260808 17:41:14.388216 19288 leader_election.cc:302] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 453e7448ee8f45668370d76a603e5481; no voters:
I20260808 17:41:14.388346 19288 leader_election.cc:288] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:14.388397 19294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:14.388572 19288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:14.388779 19294 raft_consensus.cc:686] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [term 1 LEADER]: Becoming Leader. State: Replica: 453e7448ee8f45668370d76a603e5481, State: Running, Role: LEADER
I20260808 17:41:14.388880 19294 consensus_queue.cc:237] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "453e7448ee8f45668370d76a603e5481" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33903 } }
I20260808 17:41:14.388923 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 19172
I20260808 17:41:14.389041 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:14.389261 9967 external_mini_cluster.cc:1428] Setting key f9612652d1e006d1cfd8c7c10de36ed1
I20260808 17:41:14.389235 19294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 453e7448ee8f45668370d76a603e5481. Latest consensus state: current_term: 1 leader_uuid: "453e7448ee8f45668370d76a603e5481" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "453e7448ee8f45668370d76a603e5481" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33903 } } }
I20260808 17:41:14.389312 19294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:14.389257 19296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "453e7448ee8f45668370d76a603e5481" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "453e7448ee8f45668370d76a603e5481" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33903 } } }
I20260808 17:41:14.389426 19296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481 [sys.catalog]: This master's current role is: LEADER
W20260808 17:41:14.390645 19325 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:41:14.390690 19325 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:41:14.390767 19310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:14.390939 19310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:14.392222 19310 catalog_manager.cc:1347] Generated new cluster ID: 94d35736ab39464bbab377110574c064
I20260808 17:41:14.392278 19310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:14.401410 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:14.389729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53070 (local address 127.9.187.254:33903)
0808 17:41:14.389936 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:14.389946 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:14.390224 (+ 278us) server_negotiation.cc:407] Connection header received
0808 17:41:14.390360 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:14.390366 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:14.390412 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:14.390529 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:14.391252 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.392741 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.393854 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.394492 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.394935 (+ 443us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:14.397410 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:14.397415 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:14.397416 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:14.397428 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:14.399799 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.400183 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.400186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.400187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.400308 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.400484 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.400485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.400485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.400804 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:14.400965 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:14.401043 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 17:41:14.401184 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":81,"threads_started":1}
I20260808 17:41:14.402289 19310 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:14.402789 19310 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:14.413849 19310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 453e7448ee8f45668370d76a603e5481: Generated new TSK 0
I20260808 17:41:14.414032 19310 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:41:14.442237 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33903
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:14.524243 19334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:14.524435 19334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:14.524458 19334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:14.525588 19334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:14.525630 19334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:14.525655 19334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:14.527138 19334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:14.527369 19334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:14.527578 19334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:14.532343 19340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:14.532366 19341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:14.532368 19346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:14.532570 19334 server_base.cc:1034] running on GCE node
I20260808 17:41:14.532784 19334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:14.533022 19334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:14.534189 19334 hybrid_clock.cc:648] HybridClock initialized: now 1786210874534171 us; error 29 us; skew 500 ppm
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:14.536664 19334 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:41:14.537111 19334 webserver.cc:460] Webserver started at http://127.9.187.193:40399/ using document root <none> and password file <none>
I20260808 17:41:14.537335 19334 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:14.537384 19334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:14.537544 19334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:14.538766 19334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "132ce6ed433041dba459136def1ed6cf"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "5ed7d350be281055be65d0272f112384"
server_key_iv: "975445d68109eaf685085bcb342d6979"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.539161 19334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "132ce6ed433041dba459136def1ed6cf"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "5ed7d350be281055be65d0272f112384"
server_key_iv: "975445d68109eaf685085bcb342d6979"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.540416 19334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:14.541060 19360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:14.541225 19334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:14.541313 19334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "132ce6ed433041dba459136def1ed6cf"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "5ed7d350be281055be65d0272f112384"
server_key_iv: "975445d68109eaf685085bcb342d6979"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.541376 19334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:14.567350 19334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:14.569181 19334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:14.569325 19334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:14.569556 19334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:14.569883 19334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:14.569918 19334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:14.569947 19334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:14.569970 19334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:14.575317 19334 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:46739
I20260808 17:41:14.575376 19542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:46739 every 8 connection(s)
I20260808 17:41:14.575675 19334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:41:14.577639 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 19334
I20260808 17:41:14.577725 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:14.577898 9967 external_mini_cluster.cc:1428] Setting key 74fdf97a94023a7f944ffa0d053b09ae
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:14.585238 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:14.576347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:36275 (local address 127.9.187.254:33903)
0808 17:41:14.576423 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:14.576425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:14.576597 (+ 172us) server_negotiation.cc:407] Connection header received
0808 17:41:14.577533 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:14.577535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:14.577549 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:14.577598 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:14.578392 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.579096 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.580084 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.580368 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.580423 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:14.582746 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:14.582748 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:14.582748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:14.582756 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:14.583985 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.584355 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.584357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.584357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.584410 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.584635 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.584636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.584636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.584745 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:14.584801 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:14.585066 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 17:41:14.585149 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 17:41:14.585472 19549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:14.576300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33903 (local address 127.9.187.193:36275)
0808 17:41:14.576477 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:14.576515 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:14.577421 (+ 906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:14.577679 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:14.577684 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:14.578004 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:14.578306 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:14.578314 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.579194 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.579195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:14.580003 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:14.580005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.580445 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.580445 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:14.580588 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:14.581069 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:14.581079 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:14.582658 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:14.584068 (+ 1410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:14.584075 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:14.584077 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:14.584288 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:14.584464 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:14.584465 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:14.584465 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:14.584578 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:14.584800 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:14.584807 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:14.584939 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 17:41:14.585025 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 17:41:14.585182 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260808 17:41:14.586061 19543 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33903
I20260808 17:41:14.586195 19543 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:14.586412 19543 heartbeater.cc:511] Master 127.9.187.254:33903 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
I20260808 17:41:14.586984 19226 ts_manager.cc:194] Registered new tserver with Master: 132ce6ed433041dba459136def1ed6cf (127.9.187.193:46739)
I20260808 17:41:14.587605 19226 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:36275
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:41:14.603093 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33903
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:14.685235 19553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:14.685477 19553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:14.685510 19553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:14.686700 19553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:14.686748 19553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:14.686774 19553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:14.688251 19553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:14.688509 19553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:14.688788 19553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:14.693838 19561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:14.693957 19560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:14.693992 19553 server_base.cc:1034] running on GCE node
W20260808 17:41:14.693840 19565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:14.694375 19553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:14.694607 19553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:14.695760 19553 hybrid_clock.cc:648] HybridClock initialized: now 1786210874695742 us; error 36 us; skew 500 ppm
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:14.698413 19553 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:41:14.698854 19553 webserver.cc:460] Webserver started at http://127.9.187.194:38669/ using document root <none> and password file <none>
I20260808 17:41:14.699060 19553 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:14.699106 19553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:14.699254 19553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:14.700508 19553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "9846fe816fc549da9a6e7d85cf51bf9a"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "5045313071b9e42517e443d115551d41"
server_key_iv: "e5a7b6b25e6724d1c84d38a754816344"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.700933 19553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "9846fe816fc549da9a6e7d85cf51bf9a"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "5045313071b9e42517e443d115551d41"
server_key_iv: "e5a7b6b25e6724d1c84d38a754816344"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.702546 19553 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:41:14.703202 19580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:14.703332 19553 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:14.703406 19553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "9846fe816fc549da9a6e7d85cf51bf9a"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "5045313071b9e42517e443d115551d41"
server_key_iv: "e5a7b6b25e6724d1c84d38a754816344"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.703457 19553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:14.711961 19553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:14.713744 19553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:14.713851 19553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:14.714020 19553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:14.714320 19553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:14.714354 19553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:14.714375 19553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:14.714390 19553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:14.719841 19553 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:39123
I20260808 17:41:14.719897 19771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:39123 every 8 connection(s)
I20260808 17:41:14.720181 19553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:14.727979 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 19553
I20260808 17:41:14.728071 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:14.728227 9967 external_mini_cluster.cc:1428] Setting key 7a6f1b1a5b93ce0f3dce69fb3f7f376b
I20260808 17:41:14.728863 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:14.720877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:54541 (local address 127.9.187.254:33903)
0808 17:41:14.720941 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:14.720943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:14.721101 (+ 158us) server_negotiation.cc:407] Connection header received
0808 17:41:14.722013 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:14.722014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:14.722024 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:14.722078 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:14.722727 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.723235 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.724203 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.724398 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.724453 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:14.726451 (+ 1998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:14.726453 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:14.726453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:14.726461 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:14.727470 (+ 1009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.727834 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.727834 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.727835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.727891 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.728198 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.728199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.728199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.728316 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:14.728378 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:14.728684 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 17:41:14.728775 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:41:14.729012 19777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:14.720828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33903 (local address 127.9.187.194:54541)
0808 17:41:14.720983 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:14.721023 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:14.721925 (+ 902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:14.722170 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:14.722175 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:14.722437 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:14.722632 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:14.722637 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.723317 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.723318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:14.724123 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:14.724125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.724466 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.724467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:14.724595 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:14.725028 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:14.725036 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:14.726366 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:14.727548 (+ 1182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:14.727554 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:14.727557 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:14.727767 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:14.727945 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:14.727945 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:14.727946 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:14.728051 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:14.728384 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:14.728391 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:14.728550 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 17:41:14.728655 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 17:41:14.728804 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260808 17:41:14.729441 19772 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33903
I20260808 17:41:14.729544 19772 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:14.729712 19772 heartbeater.cc:511] Master 127.9.187.254:33903 requested a full tablet report, sending...
I20260808 17:41:14.730070 19226 ts_manager.cc:194] Registered new tserver with Master: 9846fe816fc549da9a6e7d85cf51bf9a (127.9.187.194:39123)
I20260808 17:41:14.730432 19226 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:54541
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:41:14.753167 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33903
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:14.836016 19781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:14.836226 19781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:14.836251 19781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:14.837339 19781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:14.837371 19781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:14.837395 19781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:14.838992 19781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:14.839200 19781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:14.839406 19781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:14.844127 19792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:14.844168 19795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:14.844179 19790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:14.844435 19781 server_base.cc:1034] running on GCE node
I20260808 17:41:14.844652 19781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:14.844901 19781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:14.846037 19781 hybrid_clock.cc:648] HybridClock initialized: now 1786210874846029 us; error 29 us; skew 500 ppm
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:14.848505 19781 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:41:14.848923 19781 webserver.cc:460] Webserver started at http://127.9.187.195:35507/ using document root <none> and password file <none>
I20260808 17:41:14.849133 19781 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:14.849191 19781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:14.849323 19781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:14.850436 19781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "6705f67fc68044668ee385d3ab15e7e0"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "c4538896432cda6231aef599b0c17bcc"
server_key_iv: "b855a44b203298b85f781113128a8a14"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.850767 19781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "6705f67fc68044668ee385d3ab15e7e0"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "c4538896432cda6231aef599b0c17bcc"
server_key_iv: "b855a44b203298b85f781113128a8a14"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.852051 19781 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:14.852725 19810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:14.852905 19781 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:14.852989 19781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "6705f67fc68044668ee385d3ab15e7e0"
format_stamp: "Formatted at 2026-08-08 17:41:14 on dist-test-slave-bqcl"
server_key: "c4538896432cda6231aef599b0c17bcc"
server_key_iv: "b855a44b203298b85f781113128a8a14"
server_key_version: "encryptionkey@0"
I20260808 17:41:14.853049 19781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:14.866843 19781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:14.868546 19781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:14.868681 19781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:14.868897 19781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:14.869230 19781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:14.869264 19781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:14.869295 19781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:14.869313 19781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:14.874640 19781 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:40757
I20260808 17:41:14.874682 20003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:40757 every 8 connection(s)
I20260808 17:41:14.875067 19781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:41:14.878537 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 19781
I20260808 17:41:14.878612 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:14.878775 9967 external_mini_cluster.cc:1428] Setting key ee79a2bc6906f0481b84dfb39aeb51e6
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:14.883810 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:14.875829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:58605 (local address 127.9.187.254:33903)
0808 17:41:14.875882 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:14.875884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:14.876077 (+ 193us) server_negotiation.cc:407] Connection header received
0808 17:41:14.877019 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:14.877020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:14.877034 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:14.877081 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:14.877698 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.878270 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.879348 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.879539 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.879593 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:14.881506 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:14.881508 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:14.881508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:14.881515 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:14.882616 (+ 1101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.882971 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.882972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.882972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.883025 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.883234 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.883235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.883235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.883337 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:14.883393 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:14.883644 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 17:41:14.883720 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:41:14.883980 20008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:14.875785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33903 (local address 127.9.187.195:58605)
0808 17:41:14.875958 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:14.876000 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:14.876908 (+ 908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:14.877163 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:14.877167 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:14.877424 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:14.877607 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:14.877611 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.878347 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.878348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:14.879274 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:14.879277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.879604 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.879605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:14.879741 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:14.880148 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:14.880156 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:14.881422 (+ 1266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:14.882691 (+ 1269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:14.882697 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:14.882699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:14.882906 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:14.883077 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:14.883077 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:14.883078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:14.883178 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:14.883390 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:14.883397 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:14.883528 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 17:41:14.883614 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 17:41:14.883776 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
I20260808 17:41:14.884347 20005 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33903
I20260808 17:41:14.884441 20005 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:14.884611 20005 heartbeater.cc:511] Master 127.9.187.254:33903 requested a full tablet report, sending...
I20260808 17:41:14.884967 19226 ts_manager.cc:194] Registered new tserver with Master: 6705f67fc68044668ee385d3ab15e7e0 (127.9.187.195:40757)
I20260808 17:41:14.885339 19226 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:58605
I20260808 17:41:14.890470 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/test-admin.keytab.
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:14.906580 9967 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 17:41:14.908385 20017 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:14.907488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50056 (local address 127.9.187.193:46739)
0808 17:41:14.907728 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:14.907734 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:14.907745 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:41:14.907777 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:14.907779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:14.907796 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:14.907863 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:14.908313 (+ 450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50056: BlockingRecv error: recv got EOF from 127.0.0.1:50056 (error 108)
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":139,"threads_started":1}
W20260808 17:41:14.908561 9967 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/krb5cc' of type FILE
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:14.909449 9967 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:14.910290 9967 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.193@KRBTEST.COM
I20260808 17:41:14.917294 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:14.910800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50068 (local address 127.9.187.193:46739)
0808 17:41:14.910848 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:14.910849 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:14.910881 (+ 32us) server_negotiation.cc:407] Connection header received
0808 17:41:14.910932 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:14.910932 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:14.910940 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:14.910982 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:14.911322 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.912037 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.912696 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.912993 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.913043 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:14.914969 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:14.914977 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:14.914977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:14.914984 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:14.916439 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.916705 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.916708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.916708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.916757 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.916880 (+ 123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.916880 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.916880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.916994 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:14.917105 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:14.917137 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 17:41:14.917194 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 17:41:14.918938 20017 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:14.918437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50070 (local address 127.9.187.193:46739)
0808 17:41:14.918490 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:14.918492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:14.918529 (+ 37us) server_negotiation.cc:407] Connection header received
0808 17:41:14.918585 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:14.918586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:14.918596 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:14.918641 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:14.918897 (+ 256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50070: BlockingRecv error: recv got EOF from 127.0.0.1:50070 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 17:41:14.918993 9967 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/krb5cc' of type FILE
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:14.919831 9967 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:14.920619 9967 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.193@KRBTEST.COM
I20260808 17:41:14.926775 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:14.921071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50080 (local address 127.9.187.193:46739)
0808 17:41:14.921124 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:14.921125 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:14.921134 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:14.921191 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:14.921192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:14.921201 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:14.921252 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:14.921572 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.922033 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.922707 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.922906 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.922960 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:14.924716 (+ 1756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:14.924718 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:14.924718 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:14.924725 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:14.925811 (+ 1086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.926097 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.926098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.926098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.926176 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.926344 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.926345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.926345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.926435 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:14.926513 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:14.926616 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 17:41:14.926689 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 17:41:14.928071 20017 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:14.927648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50088 (local address 127.9.187.193:46739)
0808 17:41:14.927685 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:14.927687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:14.927717 (+ 30us) server_negotiation.cc:407] Connection header received
0808 17:41:14.927776 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:14.927777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:14.927784 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:14.927822 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:14.928029 (+ 207us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50088: BlockingRecv error: recv got EOF from 127.0.0.1:50088 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 17:41:14.928146 9967 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786210848752357-9967-0/krb5kdc/krb5cc' of type FILE
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:14.928958 9967 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:14.929783 9967 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 17:41:14 dist-test-slave-bqcl krb5kdc[19146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.193@KRBTEST.COM
I20260808 17:41:14.935751 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:14.930211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50094 (local address 127.9.187.193:46739)
0808 17:41:14.930267 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:14.930268 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:14.930292 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:41:14.930343 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:14.930344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:14.930350 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:14.930392 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:14.930675 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.931103 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.931709 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:14.931886 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:14.931933 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:14.933676 (+ 1743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:14.933677 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:14.933678 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:14.933683 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:14.934957 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.935243 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.935243 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.935244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.935286 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:14.935409 (+ 123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:14.935409 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:14.935409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:14.935490 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:14.935550 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:14.935622 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 17:41:14.935675 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:41:14.936383 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 19334
I20260808 17:41:14.948678 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 19553
I20260808 17:41:14.965946 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 19781
I20260808 17:41:14.974900 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 19172
2026-08-08T17:41:14Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2009 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:15 dist-test-slave-bqcl krb5kdc[20035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:15 dist-test-slave-bqcl krb5kdc[20035](info): set up 2 sockets
Aug 08 17:41:15 dist-test-slave-bqcl krb5kdc[20035](info): commencing operation
krb5kdc: starting...
W20260808 17:41:16.121690 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:16 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:16Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.254.keytab.
Entry for principal oryx/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.254.keytab.
I20260808 17:41:16.237664 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33409
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.254.keytab
--principal=oryx/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:33409
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:16.319383 20057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:16.319598 20057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:16.319621 20057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:16.320753 20057 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:16.320799 20057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:16.320814 20057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:16.320827 20057 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:16.320842 20057 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:16.322382 20057 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:33409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.254.keytab
--principal=oryx/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:16.322633 20057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:16.322860 20057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:16.327666 20072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:16.327692 20065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:16.327725 20057 server_base.cc:1034] running on GCE node
W20260808 17:41:16.327749 20066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:16.328083 20057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:16.328365 20057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:16.329511 20057 hybrid_clock.cc:648] HybridClock initialized: now 1786210876329495 us; error 28 us; skew 500 ppm
Aug 08 17:41:16 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:16.331980 20057 init.cc:377] Logged in from keytab as oryx/127.9.187.254@KRBTEST.COM (short username oryx)
I20260808 17:41:16.332425 20057 webserver.cc:460] Webserver started at http://127.9.187.254:43313/ using document root <none> and password file <none>
I20260808 17:41:16.332623 20057 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:16.332669 20057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:16.332803 20057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:16.333796 20057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "70326d8a9d8547e19708870f102210ee"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "c3194ded695ff98c316bf20b6aa9947d"
server_key_iv: "2890c0eb6f0b9fd9679d427f2a72903d"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.334113 20057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "70326d8a9d8547e19708870f102210ee"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "c3194ded695ff98c316bf20b6aa9947d"
server_key_iv: "2890c0eb6f0b9fd9679d427f2a72903d"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.335402 20057 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:41:16.336113 20085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:16.336292 20057 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:16.336385 20057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "70326d8a9d8547e19708870f102210ee"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "c3194ded695ff98c316bf20b6aa9947d"
server_key_iv: "2890c0eb6f0b9fd9679d427f2a72903d"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.336444 20057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:16.348690 20057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:16.350443 20057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:16.350569 20057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:16.354601 20057 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:33409
I20260808 17:41:16.354632 20169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:33409 every 8 connection(s)
I20260808 17:41:16.354976 20057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:16.355957 20170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:16.358217 20170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee: Bootstrap starting.
I20260808 17:41:16.358777 20170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:16.359048 20170 log.cc:824] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:16.359797 20170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee: No bootstrap required, opened a new log
I20260808 17:41:16.361383 20170 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } }
I20260808 17:41:16.361521 20170 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:16.361554 20170 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70326d8a9d8547e19708870f102210ee, State: Initialized, Role: FOLLOWER
I20260808 17:41:16.361690 20170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } }
I20260808 17:41:16.361771 20170 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:16.361804 20170 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:16.361853 20170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:16.362211 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 20057
I20260808 17:41:16.362310 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:16.362483 9967 external_mini_cluster.cc:1428] Setting key e93367c74375d3a61b41d8214083be57
I20260808 17:41:16.362834 20170 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } }
I20260808 17:41:16.362973 20170 leader_election.cc:302] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70326d8a9d8547e19708870f102210ee; no voters:
I20260808 17:41:16.363140 20170 leader_election.cc:288] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:16.363164 20180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:16.363292 20180 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 1 LEADER]: Becoming Leader. State: Replica: 70326d8a9d8547e19708870f102210ee, State: Running, Role: LEADER
I20260808 17:41:16.363405 20170 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:16.363389 20180 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } }
I20260808 17:41:16.363806 20180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70326d8a9d8547e19708870f102210ee. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } }
I20260808 17:41:16.363883 20180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:16.364074 20182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } }
I20260808 17:41:16.364157 20182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:16.364252 20187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:16.364902 20187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:16.367496 20187 catalog_manager.cc:1347] Generated new cluster ID: 022ce407ad6243ef911e1cdb5508f125
I20260808 17:41:16.367553 20187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:41:16 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:16.372893 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:16.362965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42766 (local address 127.9.187.254:33409)
0808 17:41:16.363171 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:16.363182 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:16.363278 (+ 96us) server_negotiation.cc:407] Connection header received
0808 17:41:16.363453 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:16.363461 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:16.363519 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:16.363659 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:16.364478 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.366060 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.367105 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.367576 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.367723 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:16.369906 (+ 2183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:16.369910 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:16.369911 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:16.369923 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:16.371513 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:16.371841 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:16.371844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:16.371845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:16.371947 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:16.372132 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:16.372133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:16.372133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:16.372360 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:16.372505 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:16.372605 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 17:41:16.372742 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":84,"threads_started":1}
I20260808 17:41:16.391721 20187 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:16.392292 20187 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:16.403796 20187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee: Generated new TSK 0
I20260808 17:41:16.403962 20187 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab.
Entry for principal oryx/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab.
I20260808 17:41:16.439170 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33409
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab
--principal=oryx/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:16.541568 20221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:16.541772 20221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:16.541795 20221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:16.542922 20221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:16.542963 20221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:16.542987 20221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:16.544385 20221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab
--principal=oryx/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:16.544569 20221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:16.544744 20221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:16.549384 20230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:16.549432 20231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:16.549450 20237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:16.549815 20221 server_base.cc:1034] running on GCE node
I20260808 17:41:16.550029 20221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:16.550287 20221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:16.551430 20221 hybrid_clock.cc:648] HybridClock initialized: now 1786210876551414 us; error 33 us; skew 500 ppm
Aug 08 17:41:16 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:16.553838 20221 init.cc:377] Logged in from keytab as oryx/127.9.187.193@KRBTEST.COM (short username oryx)
I20260808 17:41:16.554268 20221 webserver.cc:460] Webserver started at http://127.9.187.193:43763/ using document root <none> and password file <none>
I20260808 17:41:16.554442 20221 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:16.554481 20221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:16.554600 20221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:16.555590 20221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "8f7af4893e2db6cdfd3468b52e9d0c9e"
server_key_iv: "265329c14143d4bb3144c9bb9e7450d6"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.555891 20221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "8f7af4893e2db6cdfd3468b52e9d0c9e"
server_key_iv: "265329c14143d4bb3144c9bb9e7450d6"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.557017 20221 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:41:16.557633 20249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:16.557780 20221 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:16.557863 20221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "8f7af4893e2db6cdfd3468b52e9d0c9e"
server_key_iv: "265329c14143d4bb3144c9bb9e7450d6"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.557917 20221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:16.582270 20221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:16.584486 20221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:16.584597 20221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:16.584787 20221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:16.585050 20221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:16.585080 20221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:16.585103 20221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:16.585114 20221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:16.590654 20221 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:33693
I20260808 17:41:16.590729 20446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:33693 every 8 connection(s)
I20260808 17:41:16.591023 20221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:41:16.595191 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 20221
I20260808 17:41:16.595284 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:16.595450 9967 external_mini_cluster.cc:1428] Setting key a550dea314079ce7d71e429f04b726b4
Aug 08 17:41:16 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:16.600230 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:16.591722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:36285 (local address 127.9.187.254:33409)
0808 17:41:16.591778 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:16.591780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:16.591989 (+ 209us) server_negotiation.cc:407] Connection header received
0808 17:41:16.592462 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:16.592463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:16.592474 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:16.592529 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:16.593465 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.593975 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.594990 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.595186 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.595240 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:16.597584 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:16.597586 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:16.597586 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:16.597594 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:16.598931 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:16.599359 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:16.599359 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:16.599360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:16.599407 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:16.599656 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:16.599656 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:16.599656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:16.599752 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:16.599797 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:16.600089 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 17:41:16.600156 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:41:16.600476 20453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:16.591689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.193:36285)
0808 17:41:16.591865 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:16.591910 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:16.592386 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:16.592612 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:16.592615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:16.593197 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:16.593393 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:16.593398 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.594059 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.594060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:16.594920 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:16.594923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.595273 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.595275 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:16.595418 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:16.595897 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:16.595907 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:16.597487 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:16.599008 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:16.599016 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:16.599018 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:16.599294 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:16.599458 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:16.599458 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:16.599459 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:16.599600 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:16.599802 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:16.599808 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:16.599968 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 17:41:16.600079 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 17:41:16.600243 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":89,"threads_started":1}
I20260808 17:41:16.601002 20450 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33409
I20260808 17:41:16.601112 20450 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:16.601313 20450 heartbeater.cc:511] Master 127.9.187.254:33409 requested a full tablet report, sending...
I20260808 17:41:16.601828 20114 ts_manager.cc:194] Registered new tserver with Master: a24d2e8ce02a44f9ac6b8bfe0f44d1c7 (127.9.187.193:33693)
I20260808 17:41:16.602486 20114 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:36285
WARNING: no policy specified for oryx/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab.
Entry for principal oryx/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab.
I20260808 17:41:16.623203 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33409
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab
--principal=oryx/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:16.706387 20457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:16.706586 20457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:16.706615 20457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:16.707729 20457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:16.707772 20457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:16.707806 20457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:16.709240 20457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab
--principal=oryx/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:16.709432 20457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:16.709609 20457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:16.714301 20466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:16.714318 20464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:16.714321 20469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:16.714430 20457 server_base.cc:1034] running on GCE node
I20260808 17:41:16.714668 20457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:16.714867 20457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:16.716010 20457 hybrid_clock.cc:648] HybridClock initialized: now 1786210876715992 us; error 33 us; skew 500 ppm
Aug 08 17:41:16 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:16.718391 20457 init.cc:377] Logged in from keytab as oryx/127.9.187.194@KRBTEST.COM (short username oryx)
I20260808 17:41:16.718807 20457 webserver.cc:460] Webserver started at http://127.9.187.194:46265/ using document root <none> and password file <none>
I20260808 17:41:16.719036 20457 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:16.719090 20457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:16.719218 20457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:16.720157 20457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "45725114cd8e466bb485f66614d9e611"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "d1b0172ba2bcbab599db814a9e3712e6"
server_key_iv: "ebf1db931e0d291f2037b5ce02450e6a"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.720471 20457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "45725114cd8e466bb485f66614d9e611"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "d1b0172ba2bcbab599db814a9e3712e6"
server_key_iv: "ebf1db931e0d291f2037b5ce02450e6a"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.721655 20457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:16.722396 20487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:16.722558 20457 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:41:16.722635 20457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "45725114cd8e466bb485f66614d9e611"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "d1b0172ba2bcbab599db814a9e3712e6"
server_key_iv: "ebf1db931e0d291f2037b5ce02450e6a"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.722699 20457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:16.734033 20457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:16.736068 20457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:16.736193 20457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:16.736382 20457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:16.736656 20457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:16.736688 20457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:16.736709 20457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:16.736733 20457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:16.742245 20457 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:41487
I20260808 17:41:16.742305 20663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:41487 every 8 connection(s)
I20260808 17:41:16.742584 20457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:41:16 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:16.748435 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 20457
I20260808 17:41:16.748519 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:16.748689 9967 external_mini_cluster.cc:1428] Setting key fb9a3d018896909fb3f1ab60b41d38cc
I20260808 17:41:16.751293 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:16.743214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:54707 (local address 127.9.187.254:33409)
0808 17:41:16.743270 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:16.743272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:16.743429 (+ 157us) server_negotiation.cc:407] Connection header received
0808 17:41:16.743876 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:16.743877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:16.743887 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:16.743926 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:16.744785 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.745302 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.746269 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.746496 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.746563 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:16.748726 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:16.748728 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:16.748728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:16.748743 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:16.750024 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:16.750422 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:16.750423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:16.750423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:16.750482 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:16.750697 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:16.750698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:16.750698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:16.750817 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:16.750873 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:16.751122 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 17:41:16.751205 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:41:16.751452 20668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:16.743168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.194:54707)
0808 17:41:16.743322 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:16.743357 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:16.743788 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:16.743980 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:16.743983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:16.744527 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:16.744704 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:16.744709 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.745367 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.745368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:16.746184 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:16.746187 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.746567 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.746568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:16.746707 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:16.747207 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:16.747217 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:16.748640 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:16.750100 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:16.750106 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:16.750108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:16.750353 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:16.750536 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:16.750536 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:16.750537 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:16.750641 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:16.750871 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:16.750877 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:16.751008 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 17:41:16.751094 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 17:41:16.751252 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
I20260808 17:41:16.752053 20665 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33409
I20260808 17:41:16.752135 20665 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:16.752302 20665 heartbeater.cc:511] Master 127.9.187.254:33409 requested a full tablet report, sending...
I20260808 17:41:16.752676 20114 ts_manager.cc:194] Registered new tserver with Master: 45725114cd8e466bb485f66614d9e611 (127.9.187.194:41487)
I20260808 17:41:16.753146 20114 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:54707
WARNING: no policy specified for oryx/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab.
Entry for principal oryx/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab.
I20260808 17:41:16.773080 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33409
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab
--principal=oryx/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:16.854461 20677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:16.854676 20677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:16.854696 20677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:16.855839 20677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:16.855880 20677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:16.855907 20677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:16.857376 20677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab
--principal=oryx/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:16.857616 20677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:16.857834 20677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:16.862684 20684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:16.862804 20677 server_base.cc:1034] running on GCE node
W20260808 17:41:16.862731 20686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:16.862707 20682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:16.863129 20677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:16.863359 20677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:16.864497 20677 hybrid_clock.cc:648] HybridClock initialized: now 1786210876864477 us; error 30 us; skew 500 ppm
Aug 08 17:41:16 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:16.867200 20677 init.cc:377] Logged in from keytab as oryx/127.9.187.195@KRBTEST.COM (short username oryx)
I20260808 17:41:16.867666 20677 webserver.cc:460] Webserver started at http://127.9.187.195:37023/ using document root <none> and password file <none>
I20260808 17:41:16.867883 20677 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:16.867934 20677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:16.868065 20677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:16.869091 20677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "3745b05e726c42fd8665b3b7186e041e"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "c7fc7532d773dd234f5824c363767c33"
server_key_iv: "9fa8c7a39ddf6bc4ebde13db8b424db7"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.869431 20677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "3745b05e726c42fd8665b3b7186e041e"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "c7fc7532d773dd234f5824c363767c33"
server_key_iv: "9fa8c7a39ddf6bc4ebde13db8b424db7"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.870726 20677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 17:41:16.871403 20704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:16.871567 20677 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:16.871654 20677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "3745b05e726c42fd8665b3b7186e041e"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "c7fc7532d773dd234f5824c363767c33"
server_key_iv: "9fa8c7a39ddf6bc4ebde13db8b424db7"
server_key_version: "encryptionkey@0"
I20260808 17:41:16.871716 20677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:16.894713 20677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:16.896673 20677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:16.896836 20677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:16.897085 20677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:16.897411 20677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:16.897452 20677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:16.897486 20677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:16.897526 20677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:16.903550 20677 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:38385
I20260808 17:41:16.903589 20895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:38385 every 8 connection(s)
I20260808 17:41:16.904023 20677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:41:16.908021 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 20677
I20260808 17:41:16.908118 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:16.908283 9967 external_mini_cluster.cc:1428] Setting key edd65f18fd59f70965720ee9495c5619
Aug 08 17:41:16 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:16.912992 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:16.904778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:53127 (local address 127.9.187.254:33409)
0808 17:41:16.904844 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:16.904846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:16.905045 (+ 199us) server_negotiation.cc:407] Connection header received
0808 17:41:16.905534 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:16.905535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:16.905546 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:16.905611 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:16.906561 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.907066 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.908050 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.908295 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.908354 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:16.910520 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:16.910521 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:16.910521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:16.910529 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:16.911760 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:16.912114 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:16.912115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:16.912116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:16.912171 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:16.912382 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:16.912382 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:16.912383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:16.912496 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:16.912555 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:16.912820 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 17:41:16.912902 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 17:41:16.913142 20902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:16.904742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.195:53127)
0808 17:41:16.904915 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:16.904958 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:16.905450 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:16.905677 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:16.905680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:16.906286 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:16.906481 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:16.906487 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.907144 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.907144 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:16.907960 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:16.907962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:16.908372 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:16.908373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:16.908502 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:16.909011 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:16.909022 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:16.910434 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:16.911834 (+ 1400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:16.911841 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:16.911843 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:16.912048 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:16.912224 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:16.912225 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:16.912225 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:16.912324 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:16.912552 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:16.912559 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:16.912688 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 17:41:16.912787 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 17:41:16.912939 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260808 17:41:16.913551 20898 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33409
I20260808 17:41:16.913650 20898 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:16.913827 20898 heartbeater.cc:511] Master 127.9.187.254:33409 requested a full tablet report, sending...
I20260808 17:41:16.914209 20114 ts_manager.cc:194] Registered new tserver with Master: 3745b05e726c42fd8665b3b7186e041e (127.9.187.195:38385)
I20260808 17:41:16.914604 20114 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:53127
I20260808 17:41:16.920055 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.187.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.253.keytab.
Entry for principal oryx/127.9.187.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.253.keytab.
I20260808 17:41:16.944839 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.253:41837
--webserver_interface=127.9.187.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.253.keytab
--principal=oryx/127.9.187.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:33409,127.9.187.253:41837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:17.026213 20907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:17.026448 20907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:17.026469 20907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:17.027596 20907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:17.027639 20907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:17.027652 20907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:17.027663 20907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:17.027680 20907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:17.029101 20907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:33409,127.9.187.253:41837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.253.keytab
--principal=oryx/127.9.187.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.253:41837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.187.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
W20260808 17:41:17.029202 20907 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.9.187.254:33409,127.9.187.253:41837'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 17:41:17.029340 20907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:17.029534 20907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:17.034155 20914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:17.034164 20915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:17.034291 20917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:17.034404 20907 server_base.cc:1034] running on GCE node
I20260808 17:41:17.034682 20907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:17.034976 20907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:17.036128 20907 hybrid_clock.cc:648] HybridClock initialized: now 1786210877036116 us; error 28 us; skew 500 ppm
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:17.038699 20907 init.cc:377] Logged in from keytab as oryx/127.9.187.253@KRBTEST.COM (short username oryx)
I20260808 17:41:17.039157 20907 webserver.cc:460] Webserver started at http://127.9.187.253:46811/ using document root <none> and password file <none>
I20260808 17:41:17.039400 20907 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:17.039448 20907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:17.039587 20907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:17.040678 20907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data/instance:
uuid: "3dc41105215b4ed3ac8143cb043c0cf8"
format_stamp: "Formatted at 2026-08-08 17:41:17 on dist-test-slave-bqcl"
server_key: "e9f4ac7257602c2637fb29fed184eb93"
server_key_iv: "5d12dee577a3be885d378f1a930be3c9"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.041029 20907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/wal/instance:
uuid: "3dc41105215b4ed3ac8143cb043c0cf8"
format_stamp: "Formatted at 2026-08-08 17:41:17 on dist-test-slave-bqcl"
server_key: "e9f4ac7257602c2637fb29fed184eb93"
server_key_iv: "5d12dee577a3be885d378f1a930be3c9"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.042382 20907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:17.043059 20939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.043223 20907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:17.043308 20907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/wal
uuid: "3dc41105215b4ed3ac8143cb043c0cf8"
format_stamp: "Formatted at 2026-08-08 17:41:17 on dist-test-slave-bqcl"
server_key: "e9f4ac7257602c2637fb29fed184eb93"
server_key_iv: "5d12dee577a3be885d378f1a930be3c9"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.043362 20907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:17.053220 20907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:17.055106 20907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:17.055212 20907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:17.058838 20907 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.253:41837
I20260808 17:41:17.058887 21021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.253:41837 every 8 connection(s)
I20260808 17:41:17.059195 20907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
I20260808 17:41:17.059744 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 20907
I20260808 17:41:17.060293 21024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:17.062392 21024 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.187.253@KRBTEST.COM
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.253@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:17.069875 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.060327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45712 (local address 127.9.187.253:41837)
0808 17:41:17.060525 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.060534 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.060563 (+ 29us) server_negotiation.cc:407] Connection header received
0808 17:41:17.061035 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.061057 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.061142 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.061284 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.061896 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.063176 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.064054 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.064526 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.064639 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.067019 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.067027 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.067027 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.067034 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.068431 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.068798 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.068801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.068802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.068897 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.069090 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.069091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.069091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.069291 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.069423 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.069525 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.069670 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":153,"thread_start_us":82,"threads_started":1}
I20260808 17:41:17.070474 21034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.063005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:42774)
0808 17:41:17.063168 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.063206 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.063268 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.063427 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.063429 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.063667 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.063725 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.063727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.064459 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.064461 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.065343 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.065346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.065818 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.065819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.065869 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.066306 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.066315 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.067736 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.069382 (+ 1646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.069387 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.069389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.069620 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.069807 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.069808 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.069808 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.069869 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.070189 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.070194 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.070235 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.070302 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.070380 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":69,"threads_started":1}
I20260808 17:41:17.070495 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.063073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42774 (local address 127.9.187.254:33409)
0808 17:41:17.063138 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.063141 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.063266 (+ 125us) server_negotiation.cc:407] Connection header received
0808 17:41:17.063344 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.063346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.063357 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.063414 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.063795 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.064339 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.065425 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.065730 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.065807 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.067937 (+ 2130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.067938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.067938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.067947 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.069306 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.069687 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.069689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.069689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.069751 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.069930 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.069931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.069931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.070096 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.070201 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.070341 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.070422 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:41:17.071055 21024 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.253@KRBTEST.COM for oryx/127.9.187.253@KRBTEST.COM
I20260808 17:41:17.076314 21034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.071250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:41837 (local address 127.0.0.1:45726)
0808 17:41:17.071289 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.071299 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.071337 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.071432 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.071432 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.071531 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.071599 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.071601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.072134 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.072135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.072601 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.072602 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.072879 (+ 277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.072880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.072923 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.073250 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.073255 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.074349 (+ 1094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.075469 (+ 1120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.075470 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.075470 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.075663 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.075818 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.075818 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.075819 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.075863 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.076051 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.076052 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.076091 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.076155 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.076233 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 17:41:17.076365 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.071297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45726 (local address 127.9.187.253:41837)
0808 17:41:17.071342 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.071343 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.071369 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:41:17.071386 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.071387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.071395 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.071427 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.071647 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.072084 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.072652 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.072836 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.072876 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.074436 (+ 1560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.074436 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.074437 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.074442 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.075403 (+ 961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.075721 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.075721 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.075721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.075776 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.075902 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.075903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.075903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.075984 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.076026 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.076180 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.076278 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":27}
I20260808 17:41:17.077572 21024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: Bootstrap starting.
I20260808 17:41:17.078397 21024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:17.078636 21024 log.cc:824] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:17.079330 21024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: No bootstrap required, opened a new log
I20260808 17:41:17.080629 21024 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } }
I20260808 17:41:17.080750 21024 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:17.080773 21024 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc41105215b4ed3ac8143cb043c0cf8, State: Initialized, Role: FOLLOWER
I20260808 17:41:17.080876 21024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } }
I20260808 17:41:17.081154 21024 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:17.081128 21037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } } }
I20260808 17:41:17.081225 21037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 17:41:17.082724 21053 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:41:17.082778 21053 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:41:17.084232 20907 master_runner.cc:428] Detected that this master 3dc41105215b4ed3ac8143cb043c0cf8 is joining an existing cluster
I20260808 17:41:17.084302 20907 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.187.253:41837
I20260808 17:41:17.090732 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.085363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42778 (local address 127.9.187.254:33409)
0808 17:41:17.085408 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.085410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.085418 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:17.085441 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.085442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.085452 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.085511 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.085872 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.086416 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.087136 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.087319 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.087372 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.088205 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.088206 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.088206 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.088213 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.089668 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.090029 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.090031 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.090031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.090090 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.090269 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.090270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.090270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.090376 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.090432 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.090578 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.090644 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:41:17.090744 21060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.085154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:42778)
0808 17:41:17.085301 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.085311 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.085362 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.085519 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.085519 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.085736 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.085804 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.085805 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.086493 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.086494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.087058 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.087068 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.087388 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.087389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.087466 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.087836 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.087841 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.088127 (+ 286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.089756 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.089757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.089757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.089962 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.090158 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.090158 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.090159 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.090219 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.090430 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.090431 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.090472 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.090546 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.090642 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":108,"threads_started":1}
I20260808 17:41:17.092111 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.085378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45740 (local address 127.9.187.253:41837)
0808 17:41:17.085410 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.085411 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.085498 (+ 87us) server_negotiation.cc:407] Connection header received
0808 17:41:17.085548 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.085548 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.085556 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.085601 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.086025 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.086715 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.087682 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.087959 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.087994 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.088959 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.088961 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.088961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.088968 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.090517 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.091387 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.091388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.091388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.091447 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.091629 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.091630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.091630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.091753 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.091792 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.091956 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.092028 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:41:17.092543 21061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.085164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:41837 (local address 127.0.0.1:45740)
0808 17:41:17.085449 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.085457 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.085506 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.085616 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.085617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.085863 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.085937 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.085939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.086809 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.086809 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.087594 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.087597 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.088056 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.088056 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.088123 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.088488 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.088493 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.088867 (+ 374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.090600 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.090600 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.090601 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.091075 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.091508 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.091508 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.091508 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.091568 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.091831 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.091831 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.091864 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.092210 (+ 346us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.092293 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":71,"threads_started":1}
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.254@KRBTEST.COM for oryx/127.9.187.253@KRBTEST.COM
I20260808 17:41:17.099960 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.093127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45746 (local address 127.9.187.253:41837)
0808 17:41:17.093270 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.093272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.093280 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:17.093358 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.093358 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.093367 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.093413 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.093794 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.094497 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.095258 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.095545 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.095609 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.097634 (+ 2025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.097635 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.097635 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.097641 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.098901 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.099305 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.099306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.099306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.099352 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.099528 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.099529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.099529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.099620 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.099675 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.099853 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.099908 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260808 17:41:17.100054 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.093075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:41837 (local address 127.0.0.1:45746)
0808 17:41:17.093186 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.093225 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.093284 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.093418 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.093421 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.093685 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.093728 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.093730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.094592 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.094593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.095169 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.095180 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.095608 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.095609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.095657 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.096093 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.096097 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.097544 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.098975 (+ 1431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.098983 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.098985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.099238 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.099406 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.099407 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.099407 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.099474 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.099673 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.099679 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.099740 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.099824 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.099940 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":65,"threads_started":1}
I20260808 17:41:17.100557 20114 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.187.253:41837: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8"
member_type: NON_VOTER
last_known_addr {
host: "127.9.187.253"
port: 41837
}
attrs {
promote: true
}
}
dest_uuid: "70326d8a9d8547e19708870f102210ee"
cas_config_opid_index: -1
I20260808 17:41:17.100950 20114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } }
I20260808 17:41:17.101467 21066 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3dc41105215b4ed3ac8143cb043c0cf8 (127.9.187.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } } }
I20260808 17:41:17.101691 20983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:17.102538 20983 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Refusing update from remote peer 70326d8a9d8547e19708870f102210ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 17:41:17.102586 21066 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.187.253:41837
I20260808 17:41:17.102931 20907 master.cc:537] Master@127.9.187.253:41837 shutting down...
I20260808 17:41:17.103127 21065 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:17.103658 21067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } } }
I20260808 17:41:17.103827 21067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: This master's current role is: LEADER
W20260808 17:41:17.103890 20088 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 17:41:17.104355 20088 consensus_peers.cc:487] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee -> Peer 3dc41105215b4ed3ac8143cb043c0cf8 (127.9.187.253:41837): Couldn't send request to peer 3dc41105215b4ed3ac8143cb043c0cf8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 17:41:17.105942 20907 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:17.106029 20907 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:17.106077 20907 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: stopping tablet replica
I20260808 17:41:17.119015 20907 master.cc:552] Master@127.9.187.253:41837 shutdown complete.
I20260808 17:41:17.119067 20907 master_runner.cc:305] Clearing existing system tablet
I20260808 17:41:17.119190 20907 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:17.119234 20907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:17.119834 20907 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.002s sys 0.000s
I20260808 17:41:17.120587 21077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.120810 20907 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:17.120878 20907 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:41:17.120905 20907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/wal
uuid: "3dc41105215b4ed3ac8143cb043c0cf8"
format_stamp: "Formatted at 2026-08-08 17:41:17 on dist-test-slave-bqcl"
server_key: "e9f4ac7257602c2637fb29fed184eb93"
server_key_iv: "5d12dee577a3be885d378f1a930be3c9"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.121773 20907 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:17.123165 20907 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 17:41:17.123236 20907 log.cc:1196] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 17:41:17.123428 20907 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: Deleting consensus metadata
I20260808 17:41:17.123656 20907 master_runner.cc:315] Copying system tablet from 127.9.187.254:33409
I20260808 17:41:17.124266 20907 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: tablet copy: Beginning tablet copy session from remote peer at address 127.9.187.254:33409
I20260808 17:41:17.129896 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.124626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42788 (local address 127.9.187.254:33409)
0808 17:41:17.124675 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.124677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.124841 (+ 164us) server_negotiation.cc:407] Connection header received
0808 17:41:17.124897 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.124898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.124908 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.124961 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.125265 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.125819 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.126642 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.126839 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.126892 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.127740 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.127741 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.127742 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.127748 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.128921 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.129224 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.129226 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.129226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.129280 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.129437 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.129438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.129438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.129550 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.129606 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.129736 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.129805 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:41:17.129910 21085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.124547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:42788)
0808 17:41:17.124778 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.124787 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.124841 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.124965 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.124965 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.125134 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.125185 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.125187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.125899 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.125900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.126569 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.126572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.126897 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.126897 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.126956 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.127396 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.127399 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.127662 (+ 263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.128993 (+ 1331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.128995 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.128995 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.129164 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.129333 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.129334 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.129334 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.129389 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.129605 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.129606 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.129649 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.129708 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.129806 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":95,"threads_started":1}
I20260808 17:41:17.130323 20146 tablet_copy_service.cc:140] P 70326d8a9d8547e19708870f102210ee: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3dc41105215b4ed3ac8143cb043c0cf8 ({username='oryx', principal='oryx/127.9.187.253@KRBTEST.COM'} at 127.0.0.1:42788)
I20260808 17:41:17.130436 20146 tablet_copy_service.cc:161] P 70326d8a9d8547e19708870f102210ee: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3dc41105215b4ed3ac8143cb043c0cf8 at {username='oryx', principal='oryx/127.9.187.253@KRBTEST.COM'} at 127.0.0.1:42788: session id = 3dc41105215b4ed3ac8143cb043c0cf8-00000000000000000000000000000000
I20260808 17:41:17.131122 20146 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 17:41:17.131711 20907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 17:41:17.132898 20907 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: tablet copy: Starting download of 0 data blocks...
I20260808 17:41:17.133039 20907 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: tablet copy: Starting download of 1 WAL segments...
I20260808 17:41:17.133893 20907 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 17:41:17.134842 20146 tablet_copy_service.cc:342] P 70326d8a9d8547e19708870f102210ee: Request end of tablet copy session 3dc41105215b4ed3ac8143cb043c0cf8-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.187.253@KRBTEST.COM'} at 127.0.0.1:42788
I20260808 17:41:17.134917 20146 tablet_copy_service.cc:433] P 70326d8a9d8547e19708870f102210ee: ending tablet copy session 3dc41105215b4ed3ac8143cb043c0cf8-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3dc41105215b4ed3ac8143cb043c0cf8
I20260808 17:41:17.137660 20907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:17.138830 21089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:17.138906 21087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:17.138984 20907 server_base.cc:1034] running on GCE node
W20260808 17:41:17.138909 21091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:17.139257 20907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:17.139400 20907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:17.140527 20907 hybrid_clock.cc:648] HybridClock initialized: now 1786210877140512 us; error 31 us; skew 500 ppm
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:17.141754 20907 init.cc:377] Logged in from keytab as oryx/127.9.187.253@KRBTEST.COM (short username oryx)
I20260808 17:41:17.142028 20907 webserver.cc:460] Webserver started at http://127.9.187.253:39431/ using document root <none> and password file <none>
I20260808 17:41:17.142166 20907 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:17.142208 20907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:17.142794 20907 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:17.143317 21103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.143425 20907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.143491 20907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/wal
uuid: "3dc41105215b4ed3ac8143cb043c0cf8"
format_stamp: "Formatted at 2026-08-08 17:41:17 on dist-test-slave-bqcl"
server_key: "e9f4ac7257602c2637fb29fed184eb93"
server_key_iv: "5d12dee577a3be885d378f1a930be3c9"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.143548 20907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:17.153131 20907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:17.154495 20907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:17.157322 20907 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.253:41837
I20260808 17:41:17.157543 21193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.253:41837 every 8 connection(s)
I20260808 17:41:17.157703 20907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
I20260808 17:41:17.158450 21197 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:41:17.158839 21197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: Bootstrap starting.
I20260808 17:41:17.161105 21197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:41:17.161288 21197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: Bootstrap complete.
I20260808 17:41:17.161461 21197 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } }
I20260808 17:41:17.161527 21197 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3dc41105215b4ed3ac8143cb043c0cf8, State: Initialized, Role: LEARNER
I20260808 17:41:17.161562 21197 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } }
I20260808 17:41:17.161718 21197 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:17.161722 21201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } } }
I20260808 17:41:17.161827 21201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: This master's current role is: LEARNER
I20260808 17:41:17.163072 21218 catalog_manager.cc:1259] Loaded cluster ID: 022ce407ad6243ef911e1cdb5508f125
I20260808 17:41:17.163112 21218 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: loading cluster ID for follower catalog manager: success
I20260808 17:41:17.164014 21218 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: acquiring CA information for follower catalog manager: success
I20260808 17:41:17.164263 21218 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:41:17.178282 21219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.171417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45764 (local address 127.9.187.253:41837)
0808 17:41:17.171553 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.171555 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.171566 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:41:17.171591 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.171592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.171603 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.171684 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.172193 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.173204 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.173890 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.174239 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.174306 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.175471 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.175472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.175473 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.175480 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.176998 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.177331 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.177333 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.177333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.177401 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.177659 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.177660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.177660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.177792 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.177894 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.178044 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.178171 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
WARNING: no policy specified for oryx/127.9.187.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.252.keytab.
Entry for principal oryx/127.9.187.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.252.keytab.
I20260808 17:41:17.203142 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.252:34837
--webserver_interface=127.9.187.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.252.keytab
--principal=oryx/127.9.187.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:33409,127.9.187.253:41837,127.9.187.252:34837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:17.286033 21223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:17.286270 21223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:17.286294 21223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:17.287412 21223 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:17.287463 21223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:17.287478 21223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:17.287503 21223 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:17.287524 21223 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:17.289043 21223 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:33409,127.9.187.253:41837,127.9.187.252:34837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.252.keytab
--principal=oryx/127.9.187.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.252:34837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.187.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:17.289275 21223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:17.289489 21223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:17.294080 21230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:17.294090 21229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:17.294204 21233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:17.294461 21223 server_base.cc:1034] running on GCE node
I20260808 17:41:17.294694 21223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:17.294973 21223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:17.296113 21223 hybrid_clock.cc:648] HybridClock initialized: now 1786210877296102 us; error 32 us; skew 500 ppm
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:17.298545 21223 init.cc:377] Logged in from keytab as oryx/127.9.187.252@KRBTEST.COM (short username oryx)
I20260808 17:41:17.298949 21223 webserver.cc:460] Webserver started at http://127.9.187.252:39557/ using document root <none> and password file <none>
I20260808 17:41:17.299157 21223 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:17.299204 21223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:17.299345 21223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:17.300348 21223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data/instance:
uuid: "3309fa1dc71d4bf4b0ce262b0df9c638"
format_stamp: "Formatted at 2026-08-08 17:41:17 on dist-test-slave-bqcl"
server_key: "3e72fe26d4f480a8d3d053b4f74814f3"
server_key_iv: "6b80b5eb94b97937ca15a20da66fb73e"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.300683 21223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/wal/instance:
uuid: "3309fa1dc71d4bf4b0ce262b0df9c638"
format_stamp: "Formatted at 2026-08-08 17:41:17 on dist-test-slave-bqcl"
server_key: "3e72fe26d4f480a8d3d053b4f74814f3"
server_key_iv: "6b80b5eb94b97937ca15a20da66fb73e"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.301896 21223 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:17.302604 21245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.302757 21223 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.302834 21223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/wal
uuid: "3309fa1dc71d4bf4b0ce262b0df9c638"
format_stamp: "Formatted at 2026-08-08 17:41:17 on dist-test-slave-bqcl"
server_key: "3e72fe26d4f480a8d3d053b4f74814f3"
server_key_iv: "6b80b5eb94b97937ca15a20da66fb73e"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.302901 21223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:17.311012 21223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:17.312834 21223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:17.312960 21223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:17.316830 21223 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.252:34837
I20260808 17:41:17.316871 21325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.252:34837 every 8 connection(s)
I20260808 17:41:17.317181 21223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
I20260808 17:41:17.318104 21326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:17.318293 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 21223
I20260808 17:41:17.320283 21326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.187.252@KRBTEST.COM
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.252@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:17.328372 21328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.318913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37322 (local address 127.9.187.252:34837)
0808 17:41:17.319065 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.319075 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.319105 (+ 30us) server_negotiation.cc:407] Connection header received
0808 17:41:17.319585 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.319595 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.319660 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.319806 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.320336 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.321450 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.322253 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.322644 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.322736 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.325196 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.325205 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.325205 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.325213 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.326827 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.327180 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.327181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.327182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.327257 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.327456 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.327456 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.327457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.327791 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.327913 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.328034 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.328158 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":60,"threads_started":1}
I20260808 17:41:17.328573 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.321077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42794 (local address 127.9.187.254:33409)
0808 17:41:17.321132 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.321135 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.321640 (+ 505us) server_negotiation.cc:407] Connection header received
0808 17:41:17.321690 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.321691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.321703 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.321758 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.322159 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.322656 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.323536 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.323846 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.323920 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.325978 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.325979 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.325979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.325986 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.327384 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.327789 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.327790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.327790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.327845 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.328033 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.328034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.328034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.328162 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.328243 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.328404 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.328480 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:41:17.328588 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.320925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:42794)
0808 17:41:17.321560 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.321587 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.321631 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.321775 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.321778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.322008 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.322077 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.322079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.322748 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.322749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.323451 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.323453 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.323941 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.323942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.323991 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.324401 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.324409 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.325904 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.327457 (+ 1553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.327464 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.327466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.327724 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.327906 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.327907 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.327907 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.327972 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.328232 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.328239 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.328292 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.328368 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.328481 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":83,"threads_started":1}
I20260808 17:41:17.329232 21326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.252@KRBTEST.COM for oryx/127.9.187.253@KRBTEST.COM
I20260808 17:41:17.334860 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.329451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:41837 (local address 127.0.0.1:45772)
0808 17:41:17.329491 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.329502 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.329538 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.329670 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.329671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.329776 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.329817 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.329818 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.330469 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.330470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.330965 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.330967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.331260 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.331260 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.331307 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.331595 (+ 288us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.331598 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.332643 (+ 1045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.334039 (+ 1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.334040 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.334040 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.334236 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.334377 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.334377 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.334377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.334421 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.334617 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.334618 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.334658 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.334728 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.334800 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 17:41:17.334869 21219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.329525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45772 (local address 127.9.187.253:41837)
0808 17:41:17.329580 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.329582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.329589 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:41:17.329610 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.329611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.329622 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.329668 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.329865 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.330393 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.331025 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.331208 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.331254 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.332721 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.332722 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.332722 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.332729 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.333963 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.334283 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.334284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.334284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.334331 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.334453 (+ 122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.334454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.334454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.334541 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.334585 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.334746 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.334809 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:41:17.335394 21326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.252@KRBTEST.COM for oryx/127.9.187.252@KRBTEST.COM
I20260808 17:41:17.340859 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.335637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:34837 (local address 127.0.0.1:37324)
0808 17:41:17.335679 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.335689 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.335732 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.335832 (+ 100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.335833 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.335952 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.335975 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.335976 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.336542 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.336542 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.336989 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.336990 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.337292 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.337293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.337337 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.337620 (+ 283us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.337623 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.338649 (+ 1026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.340014 (+ 1365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.340015 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.340015 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.340163 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.340317 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.340317 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.340318 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.340369 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.340560 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.340561 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.340595 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.340654 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.340763 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 17:41:17.340911 21328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.335678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37324 (local address 127.9.187.252:34837)
0808 17:41:17.335707 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.335709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.335719 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:17.335774 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.335775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.335782 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.335825 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.336041 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.336471 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.337058 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.337240 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.337290 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.338726 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.338727 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.338727 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.338742 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.339945 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.340219 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.340220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.340220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.340267 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.340417 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.340418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.340418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.340508 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.340559 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.340680 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.340814 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":17}
I20260808 17:41:17.342272 21326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: Bootstrap starting.
I20260808 17:41:17.343114 21326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:17.343410 21326 log.cc:824] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:17.344149 21326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: No bootstrap required, opened a new log
I20260808 17:41:17.345770 21326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } }
I20260808 17:41:17.345892 21326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:17.345924 21326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3309fa1dc71d4bf4b0ce262b0df9c638, State: Initialized, Role: FOLLOWER
I20260808 17:41:17.346042 21326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } }
I20260808 17:41:17.346360 21326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:17.346329 21336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } } }
I20260808 17:41:17.346417 21336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 17:41:17.347860 21358 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:41:17.347916 21358 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:41:17.349992 21223 master_runner.cc:428] Detected that this master 3309fa1dc71d4bf4b0ce262b0df9c638 is joining an existing cluster
I20260808 17:41:17.350044 21223 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.187.252:34837
I20260808 17:41:17.360998 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.351235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42804 (local address 127.9.187.254:33409)
0808 17:41:17.351283 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.351285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.351417 (+ 132us) server_negotiation.cc:407] Connection header received
0808 17:41:17.351499 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.351500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.351511 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.351539 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.352042 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.352656 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.353445 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.353755 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.353825 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.358240 (+ 4415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.358242 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.358242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.358249 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.359898 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.360293 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.360294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.360294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.360347 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.360547 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.360548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.360548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.360651 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.360699 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.360873 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.360938 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:41:17.361047 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.351198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:42804)
0808 17:41:17.351344 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.351354 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.351421 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.351599 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.351600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.351874 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.351951 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.351953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.352730 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.352730 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.353359 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.353361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.353899 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.353901 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.353973 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.357635 (+ 3662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.357640 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.358117 (+ 477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.359986 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.359987 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.359988 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.360214 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.360400 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.360400 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.360401 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.360478 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.360721 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.360722 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.360768 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.360833 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.360933 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210876, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.254@KRBTEST.COM for oryx/127.9.187.252@KRBTEST.COM
I20260808 17:41:17.379750 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 20221
I20260808 17:41:17.387288 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.363384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:34837 (local address 127.0.0.1:37342)
0808 17:41:17.363456 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.363468 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.363513 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.363720 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.363721 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.363883 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.363955 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.363958 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.364912 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.364912 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.365501 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.365503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.365994 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.365995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.366063 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.366450 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.366453 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.367815 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.386115 (+ 18300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.386117 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.386118 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.386395 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.386623 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.386624 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.386625 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.386687 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.386953 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.386954 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.387003 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.387047 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.387180 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 17:41:17.387727 21371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.363452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37342 (local address 127.9.187.252:34837)
0808 17:41:17.363591 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.363593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.363601 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:17.363632 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.363633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.363647 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.363701 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.364053 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.364839 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.365578 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.365903 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.365974 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.367923 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.367925 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.367925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.367932 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.385975 (+ 18043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.386485 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.386486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.386487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.386548 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.386748 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.386749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.386749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.386881 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.387477 (+ 596us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.387533 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.387623 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":80,"threads_started":1}
I20260808 17:41:17.389855 20114 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.187.252:34837: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638"
member_type: NON_VOTER
last_known_addr {
host: "127.9.187.252"
port: 34837
}
attrs {
promote: true
}
}
dest_uuid: "70326d8a9d8547e19708870f102210ee"
cas_config_opid_index: 5
I20260808 17:41:17.390606 20114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } }
I20260808 17:41:17.391062 21067 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3309fa1dc71d4bf4b0ce262b0df9c638 (127.9.187.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.392069 21067 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.187.252:34837
I20260808 17:41:17.392153 21067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.392218 21067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:17.392810 21289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:17.393498 21223 master.cc:537] Master@127.9.187.252:34837 shutting down...
I20260808 17:41:17.393756 21289 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 FOLLOWER]: Refusing update from remote peer 70326d8a9d8547e19708870f102210ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 17:41:17.394052 21065 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 17:41:17.394742 20088 consensus_peers.cc:487] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee -> Peer 3309fa1dc71d4bf4b0ce262b0df9c638 (127.9.187.252:34837): Couldn't send request to peer 3309fa1dc71d4bf4b0ce262b0df9c638. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 17:41:17.395829 21369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.351528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:34837 (local address 127.0.0.1:37338)
0808 17:41:17.353480 (+ 1952us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.353488 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.353546 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.353680 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.353681 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.353856 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.353905 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.353907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.354706 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.354707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.355192 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.355194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.355501 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.355502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.355557 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.378780 (+ 23223us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.378784 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.379259 (+ 475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.393194 (+ 13935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.393195 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.393195 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.393408 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.394978 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.394979 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.394979 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.395042 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.395500 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.395501 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.395552 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.395613 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.395721 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1938,"thread_start_us":74,"threads_started":1}
I20260808 17:41:17.396370 21328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.351667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37338 (local address 127.9.187.252:34837)
0808 17:41:17.351700 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.351701 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.353527 (+ 1826us) server_negotiation.cc:407] Connection header received
0808 17:41:17.353599 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.353599 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.353606 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.353639 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.353984 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.354631 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.355277 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.355443 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.355496 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.379359 (+ 23863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.379360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.379360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.379366 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.391511 (+ 12145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.394839 (+ 3328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.394840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.394841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.394909 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.395239 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.395240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.395240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.395409 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.395470 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.396177 (+ 707us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.396287 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:41:17.396981 21219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.351463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45774 (local address 127.9.187.253:41837)
0808 17:41:17.351505 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.351507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.351877 (+ 370us) server_negotiation.cc:407] Connection header received
0808 17:41:17.351927 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.351928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.351940 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.352001 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.352323 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.353086 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.354013 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.354347 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.354389 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.379835 (+ 25446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.379836 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.379837 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.379845 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.390842 (+ 10997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.391908 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.391909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.391910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.391972 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.392182 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.392182 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.392183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.392318 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.392358 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.396796 (+ 4438us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.396891 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:41:17.397528 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.351200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:41837 (local address 127.0.0.1:45774)
0808 17:41:17.351787 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.351797 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.351875 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.352011 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.352011 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.352188 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.352248 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.352250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.353172 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.353173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.353919 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.353921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.354463 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.354464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.354588 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.378723 (+ 24135us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.378728 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.379722 (+ 994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.391642 (+ 11920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.391643 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.391643 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.391826 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.392034 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.392035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.392035 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.392090 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.392429 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.392429 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.392475 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.397250 (+ 4775us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.397411 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"spinlock_wait_cycles":37248,"thread_start_us":127,"threads_started":1}
I20260808 17:41:17.398505 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.392445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:41837 (local address 127.0.0.1:45782)
0808 17:41:17.392829 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.392840 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.392881 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.395159 (+ 2278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.395160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.395162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:17.395214 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.395215 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.396238 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.396239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.397440 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.397443 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.398268 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.398269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.398339 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.398367 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.398396 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.398438 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367}
I20260808 17:41:17.398720 21223 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:17.398859 21223 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:17.398948 21223 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: stopping tablet replica
I20260808 17:41:17.398960 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:33693
--local_ip_for_outbound_sockets=127.9.187.193
--tserver_master_addrs=127.9.187.254:33409
--webserver_port=43763
--webserver_interface=127.9.187.193
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab
--principal=oryx/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.187.254:33409,127.9.187.253:41837
--tserver_master_addrs=127.9.187.254:33409,127.9.187.253:41837,127.9.187.252:34837 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:41:17.398972 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.392668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45782 (local address 127.9.187.253:41837)
0808 17:41:17.394962 (+ 2294us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.394964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.394973 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:17.394996 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.394997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.395022 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.395270 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:17.395307 (+ 37us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.396151 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.397542 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.398172 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.398752 (+ 580us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.398840 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.398861 (+ 21us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.398903 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2271,"thread_start_us":56,"threads_started":1}
I20260808 17:41:17.399209 21148 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 LEARNER]: Refusing update from remote peer 70326d8a9d8547e19708870f102210ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 17:41:17.399500 21065 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 17:41:17.400209 21148 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3309fa1dc71d4bf4b0ce262b0df9c638 (127.9.187.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.401480 21065 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee: attempting to promote NON_VOTER 3dc41105215b4ed3ac8143cb043c0cf8 to VOTER
I20260808 17:41:17.401518 21201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70326d8a9d8547e19708870f102210ee. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.401616 21201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: This master's current role is: LEARNER
I20260808 17:41:17.401651 21201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: NON_VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: true } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.401684 21201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: This master's current role is: LEARNER
I20260808 17:41:17.401676 21065 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } }
I20260808 17:41:17.402693 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.402586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:34837 (local address 127.0.0.1:37356)
0808 17:41:17.402629 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.402667 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:34837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 17:41:17.402837 20088 consensus_peers.cc:487] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee -> Peer 3309fa1dc71d4bf4b0ce262b0df9c638 (127.9.187.252:34837): Couldn't send request to peer 3309fa1dc71d4bf4b0ce262b0df9c638. Status: Network error: Client connection negotiation failed: client connection to 127.9.187.252:34837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 17:41:17.403318 21148 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 LEARNER]: Refusing update from remote peer 70326d8a9d8547e19708870f102210ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 17:41:17.403544 21067 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 17:41:17.404204 21066 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3dc41105215b4ed3ac8143cb043c0cf8 (127.9.187.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.405107 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.404771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:34837 (local address 127.0.0.1:37372)
0808 17:41:17.405038 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.405079 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:34837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228}
I20260808 17:41:17.405067 21066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.405153 21066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:17.405200 21066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.405260 21066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:17.405556 21148 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3dc41105215b4ed3ac8143cb043c0cf8 (127.9.187.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.406545 21377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.406633 21377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:41:17.414670 21223 master.cc:552] Master@127.9.187.252:34837 shutdown complete.
I20260808 17:41:17.414721 21223 master_runner.cc:305] Clearing existing system tablet
I20260808 17:41:17.414844 21223 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:17.414884 21223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:17.415586 21223 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:17.416091 21381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.416249 21223 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:17.416308 21223 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.416330 21223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/wal
uuid: "3309fa1dc71d4bf4b0ce262b0df9c638"
format_stamp: "Formatted at 2026-08-08 17:41:17 on dist-test-slave-bqcl"
server_key: "3e72fe26d4f480a8d3d053b4f74814f3"
server_key_iv: "6b80b5eb94b97937ca15a20da66fb73e"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.417060 21223 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:17.418800 21223 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 17:41:17.418872 21223 log.cc:1196] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 17:41:17.419049 21223 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: Deleting consensus metadata
I20260808 17:41:17.419229 21223 master_runner.cc:315] Copying system tablet from 127.9.187.254:33409
I20260808 17:41:17.419818 21223 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: tablet copy: Beginning tablet copy session from remote peer at address 127.9.187.254:33409
I20260808 17:41:17.428985 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.420161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42814 (local address 127.9.187.254:33409)
0808 17:41:17.420202 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.420204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.422295 (+ 2091us) server_negotiation.cc:407] Connection header received
0808 17:41:17.422363 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.422364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.422377 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.422445 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.422800 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.423567 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.424619 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.424920 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.424982 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.426085 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.426086 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.426086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.426094 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.427776 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.428183 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.428184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.428185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.428247 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.428447 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.428448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.428448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.428580 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.428642 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.428821 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.428900 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:41:17.428996 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.420099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:42814)
0808 17:41:17.422213 (+ 2114us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.422226 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.422296 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.422460 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.422461 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.422670 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.422725 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.422727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.423657 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.423658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.424522 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.424525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.424990 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.424991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.425083 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.425606 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.425612 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.425994 (+ 382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.427863 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.427864 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.427864 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.428084 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.428311 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.428311 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.428312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.428384 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.428648 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.428649 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.428711 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.428788 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.428895 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2090,"thread_start_us":79,"threads_started":1}
I20260808 17:41:17.429458 20146 tablet_copy_service.cc:140] P 70326d8a9d8547e19708870f102210ee: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3309fa1dc71d4bf4b0ce262b0df9c638 ({username='oryx', principal='oryx/127.9.187.252@KRBTEST.COM'} at 127.0.0.1:42814)
I20260808 17:41:17.429525 20146 tablet_copy_service.cc:161] P 70326d8a9d8547e19708870f102210ee: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3309fa1dc71d4bf4b0ce262b0df9c638 at {username='oryx', principal='oryx/127.9.187.252@KRBTEST.COM'} at 127.0.0.1:42814: session id = 3309fa1dc71d4bf4b0ce262b0df9c638-00000000000000000000000000000000
I20260808 17:41:17.430097 20146 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 17:41:17.430599 21223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 17:41:17.431691 21223 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: tablet copy: Starting download of 0 data blocks...
I20260808 17:41:17.431810 21223 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: tablet copy: Starting download of 1 WAL segments...
I20260808 17:41:17.432605 21223 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 17:41:17.433475 20146 tablet_copy_service.cc:342] P 70326d8a9d8547e19708870f102210ee: Request end of tablet copy session 3309fa1dc71d4bf4b0ce262b0df9c638-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.187.252@KRBTEST.COM'} at 127.0.0.1:42814
I20260808 17:41:17.433537 20146 tablet_copy_service.cc:433] P 70326d8a9d8547e19708870f102210ee: ending tablet copy session 3309fa1dc71d4bf4b0ce262b0df9c638-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3309fa1dc71d4bf4b0ce262b0df9c638
I20260808 17:41:17.435976 21223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:17.437354 21392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:17.437462 21223 server_base.cc:1034] running on GCE node
W20260808 17:41:17.437646 21400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:17.437855 21393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:17.438038 21223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:17.438216 21223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:17.439332 21223 hybrid_clock.cc:648] HybridClock initialized: now 1786210877439321 us; error 27 us; skew 500 ppm
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:17.440816 21223 init.cc:377] Logged in from keytab as oryx/127.9.187.252@KRBTEST.COM (short username oryx)
I20260808 17:41:17.441080 21223 webserver.cc:460] Webserver started at http://127.9.187.252:46153/ using document root <none> and password file <none>
I20260808 17:41:17.441202 21223 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:17.441239 21223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:17.441921 21223 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:17.442507 21416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.442684 21223 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.442744 21223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/wal
uuid: "3309fa1dc71d4bf4b0ce262b0df9c638"
format_stamp: "Formatted at 2026-08-08 17:41:17 on dist-test-slave-bqcl"
server_key: "3e72fe26d4f480a8d3d053b4f74814f3"
server_key_iv: "6b80b5eb94b97937ca15a20da66fb73e"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.442800 21223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:17.458003 21223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:17.459721 21223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:17.463018 21223 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.252:34837
I20260808 17:41:17.463442 21223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
I20260808 17:41:17.464465 21510 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:41:17.464975 21510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: Bootstrap starting.
I20260808 17:41:17.467931 21510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:41:17.468159 21510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: Bootstrap complete.
I20260808 17:41:17.468374 21510 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } }
I20260808 17:41:17.468466 21510 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3309fa1dc71d4bf4b0ce262b0df9c638, State: Initialized, Role: LEARNER
I20260808 17:41:17.468508 21510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } }
I20260808 17:41:17.468694 21510 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:17.468788 21514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.468966 21514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: This master's current role is: LEARNER
I20260808 17:41:17.470148 21538 catalog_manager.cc:1259] Loaded cluster ID: 022ce407ad6243ef911e1cdb5508f125
I20260808 17:41:17.470201 21506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.252:34837 every 8 connection(s)
I20260808 17:41:17.470445 21538 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: loading cluster ID for follower catalog manager: success
I20260808 17:41:17.471717 21538 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: acquiring CA information for follower catalog manager: success
I20260808 17:41:17.472014 21538 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 17:41:17.495325 21376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:17.495522 21376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:17.495543 21376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:17.496685 21376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:17.496726 21376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:17.496752 21376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:17.498262 21376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab
--principal=oryx/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:33693
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=43763
--tserver_master_addrs=127.9.187.254:33409,127.9.187.253:41837,127.9.187.252:34837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:17.498481 21376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:17.498725 21376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:17.504436 21552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:17.504431 21556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:17.504427 21550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:17.504614 21376 server_base.cc:1034] running on GCE node
I20260808 17:41:17.504863 21376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:17.505110 21376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:17.506240 21376 hybrid_clock.cc:648] HybridClock initialized: now 1786210877506227 us; error 32 us; skew 500 ppm
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:17.508643 21376 init.cc:377] Logged in from keytab as oryx/127.9.187.193@KRBTEST.COM (short username oryx)
I20260808 17:41:17.509083 21376 webserver.cc:460] Webserver started at http://127.9.187.193:43763/ using document root <none> and password file <none>
I20260808 17:41:17.509279 21376 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:17.509337 21376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:17.510736 21376 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:41:17.511286 21568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.511438 21376 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:17.511521 21376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "8f7af4893e2db6cdfd3468b52e9d0c9e"
server_key_iv: "265329c14143d4bb3144c9bb9e7450d6"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.511924 21376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:17.520968 21376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:17.523154 21376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:17.523358 21376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:17.523590 21376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:17.523890 21376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:17.523928 21376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.523960 21376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:17.523988 21376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.533339 21376 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:33693
I20260808 17:41:17.533413 21760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:33693 every 8 connection(s)
I20260808 17:41:17.533771 21376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:41:17.535334 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 21376
I20260808 17:41:17.535468 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 20457
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.252@KRBTEST.COM
I20260808 17:41:17.544956 21767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.534554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:34837 (local address 127.9.187.193:57277)
0808 17:41:17.534818 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.534865 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.536024 (+ 1159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.536360 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.536363 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.536646 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.536891 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.536895 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.537901 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.537902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.538908 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.538911 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.539349 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.539350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.539456 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.539945 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.539954 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.541522 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.543294 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.543301 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.543304 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.543676 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.543931 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.543932 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.543932 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.544059 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.544367 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.544373 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.544521 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.544612 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.544754 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":85,"threads_started":1}
I20260808 17:41:17.545652 21771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.534913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:57277 (local address 127.9.187.252:34837)
0808 17:41:17.535109 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.535111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.535119 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:17.536180 (+ 1061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.536181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.536195 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.536252 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.536988 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.537807 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.538999 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.539200 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.539290 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.541627 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.541628 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.541629 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.541636 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.543209 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.543797 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.543799 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.543799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.543860 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.544124 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.544125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.544125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.544290 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.544343 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.545088 (+ 745us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.545171 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":88,"threads_started":1}
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:17.552495 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.534853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:39747 (local address 127.9.187.254:33409)
0808 17:41:17.534905 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.534907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.535012 (+ 105us) server_negotiation.cc:407] Connection header received
0808 17:41:17.542873 (+ 7861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.542875 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.542889 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.542924 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.543834 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.544835 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.546452 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.546826 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.546878 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.549638 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.549639 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.549640 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.549648 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.551454 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.551800 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.551801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.551802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.551875 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.552068 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.552069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.552069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.552173 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.552205 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.552353 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.552421 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:41:17.552960 21768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.534555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.193:39747)
0808 17:41:17.534943 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.534953 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.542745 (+ 7792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.543014 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.543015 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.543389 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.543705 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.543709 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.545118 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.545120 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.546318 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.546323 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.546973 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.546975 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.547055 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.547982 (+ 927us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.548007 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.549542 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.551527 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.551527 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.551528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.551691 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.551956 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.551957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.551957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.552011 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.552239 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.552239 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.552274 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.552781 (+ 507us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.552876 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":138,"threads_started":1}
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.253@KRBTEST.COM
I20260808 17:41:17.560644 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.534994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:40853 (local address 127.9.187.253:41837)
0808 17:41:17.535034 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.535036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.535166 (+ 130us) server_negotiation.cc:407] Connection header received
0808 17:41:17.550759 (+ 15593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.550760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.550776 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.550874 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.551309 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.552302 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.553670 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.553898 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.553958 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.556668 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.556670 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.556670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.556679 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.558927 (+ 2248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.559462 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.559463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.559463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.559557 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.559854 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.559855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.559856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.560044 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.560104 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.560401 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.560531 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:41:17.561091 21770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.534830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:41837 (local address 127.9.187.193:40853)
0808 17:41:17.535089 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.535099 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.550628 (+ 15529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.550891 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.550892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.551120 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.551169 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.551171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.552435 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.552436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.553579 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.553583 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.553987 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.553989 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.554051 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.554627 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.554633 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.556527 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.559051 (+ 2524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.559052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.559053 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.559339 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.559661 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.559662 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.559663 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.559745 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.560174 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.560175 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.560232 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.560743 (+ 511us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.560874 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":61,"threads_started":1}
I20260808 17:41:17.577069 21761 heartbeater.cc:347] Connected to a master server at 127.9.187.252:34837
I20260808 17:41:17.577184 21761 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:17.577373 21761 heartbeater.cc:511] Master 127.9.187.252:34837 requested a full tablet report, sending...
I20260808 17:41:17.578073 21441 ts_manager.cc:194] Registered new tserver with Master: a24d2e8ce02a44f9ac6b8bfe0f44d1c7 (127.9.187.193:33693)
I20260808 17:41:17.578272 21762 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33409
I20260808 17:41:17.578337 21762 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:17.578459 21762 heartbeater.cc:511] Master 127.9.187.254:33409 requested a full tablet report, sending...
I20260808 17:41:17.578336 21765 heartbeater.cc:347] Connected to a master server at 127.9.187.253:41837
I20260808 17:41:17.578595 21765 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:17.578652 21765 heartbeater.cc:511] Master 127.9.187.253:41837 requested a full tablet report, sending...
I20260808 17:41:17.578974 21130 ts_manager.cc:194] Registered new tserver with Master: a24d2e8ce02a44f9ac6b8bfe0f44d1c7 (127.9.187.193:33693)
I20260808 17:41:17.579210 20114 ts_manager.cc:194] Re-registered known tserver with Master: a24d2e8ce02a44f9ac6b8bfe0f44d1c7 (127.9.187.193:33693)
I20260808 17:41:17.579586 20114 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:39747
I20260808 17:41:17.581928 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:41487
--local_ip_for_outbound_sockets=127.9.187.194
--tserver_master_addrs=127.9.187.254:33409
--webserver_port=46265
--webserver_interface=127.9.187.194
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab
--principal=oryx/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.187.254:33409,127.9.187.253:41837
--tserver_master_addrs=127.9.187.254:33409,127.9.187.253:41837,127.9.187.252:34837 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:17.662627 21772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:17.662844 21772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:17.662874 21772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:17.664160 21772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:17.664206 21772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:17.664239 21772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:17.665796 21772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab
--principal=oryx/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:41487
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=46265
--tserver_master_addrs=127.9.187.254:33409,127.9.187.253:41837,127.9.187.252:34837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:17.666024 21772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:17.666261 21772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:17.671401 21781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:17.671386 21783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:17.671442 21772 server_base.cc:1034] running on GCE node
W20260808 17:41:17.671383 21779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:17.671818 21772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:17.672050 21772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:17.673187 21772 hybrid_clock.cc:648] HybridClock initialized: now 1786210877673175 us; error 27 us; skew 500 ppm
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:17.675830 21772 init.cc:377] Logged in from keytab as oryx/127.9.187.194@KRBTEST.COM (short username oryx)
I20260808 17:41:17.676219 21772 webserver.cc:460] Webserver started at http://127.9.187.194:46265/ using document root <none> and password file <none>
I20260808 17:41:17.676417 21772 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:17.676481 21772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:17.677753 21772 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:41:17.678305 21792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.678450 21772 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:17.678532 21772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "45725114cd8e466bb485f66614d9e611"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "d1b0172ba2bcbab599db814a9e3712e6"
server_key_iv: "ebf1db931e0d291f2037b5ce02450e6a"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.678839 21772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:17.690651 21772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:17.692440 21772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:17.692549 21772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:17.692744 21772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:17.693003 21772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:17.693035 21772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.693055 21772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:17.693078 21772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.698520 21772 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:41487
I20260808 17:41:17.698565 21970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:41487 every 8 connection(s)
I20260808 17:41:17.698864 21772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.252@KRBTEST.COM
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.253@KRBTEST.COM
I20260808 17:41:17.706794 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 21772
I20260808 17:41:17.706936 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 20677
I20260808 17:41:17.715229 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.699921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:58535 (local address 127.9.187.253:41837)
0808 17:41:17.699971 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.699973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.699981 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:17.700439 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.700440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.700449 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.700498 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.702183 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.702934 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.703813 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.704038 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.704090 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.707186 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.707188 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.707188 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.707195 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.713914 (+ 6719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.714306 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.714307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.714308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.714359 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.714593 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.714593 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.714594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.714710 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.714749 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.715073 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.715151 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:41:17.715818 21980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.699793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:41837 (local address 127.9.187.194:58535)
0808 17:41:17.699889 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.699899 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.700353 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.700570 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.700574 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.701110 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.701227 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.701240 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.703013 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.703014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.703717 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.703719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.704098 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.704099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.704160 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.704528 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.704538 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.707089 (+ 2551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.713984 (+ 6895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.713989 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.713991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.714240 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.714441 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.714442 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.714442 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.714530 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.714816 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.714822 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.714957 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.715523 (+ 566us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.715660 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"mutex_wait_us":47,"thread_start_us":60,"threads_started":1}
I20260808 17:41:17.716336 21973 heartbeater.cc:347] Connected to a master server at 127.9.187.253:41837
I20260808 17:41:17.716411 21973 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:17.716573 21973 heartbeater.cc:511] Master 127.9.187.253:41837 requested a full tablet report, sending...
I20260808 17:41:17.716961 21130 ts_manager.cc:194] Registered new tserver with Master: 45725114cd8e466bb485f66614d9e611 (127.9.187.194:41487)
I20260808 17:41:17.745131 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.699547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:46049 (local address 127.9.187.254:33409)
0808 17:41:17.699591 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.699593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.699803 (+ 210us) server_negotiation.cc:407] Connection header received
0808 17:41:17.700583 (+ 780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.700584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.700596 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.700643 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.701317 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.702106 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.703866 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.704147 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.704220 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.706752 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.706754 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.706754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.706763 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.744018 (+ 37255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.744385 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.744386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.744387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.744438 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.744605 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.744606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.744607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.744748 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.744792 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.744965 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.745051 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:41:17.745414 21977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.699505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.194:46049)
0808 17:41:17.699684 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.699718 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.700484 (+ 766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.700703 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.700704 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.701012 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.701226 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.701231 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.703039 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.703040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.703743 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.703745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.704228 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.704228 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.704289 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.704615 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.704618 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.706623 (+ 2005us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.744127 (+ 37504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.744129 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.744129 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.744320 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.744491 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.744491 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.744492 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.744538 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.744833 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.744834 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.744875 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.745201 (+ 326us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.745320 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":2,"thread_start_us":94,"threads_started":1}
I20260808 17:41:17.745746 21972 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33409
I20260808 17:41:17.745806 21972 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:17.745874 21972 heartbeater.cc:511] Master 127.9.187.254:33409 requested a full tablet report, sending...
I20260808 17:41:17.746767 20114 ts_manager.cc:194] Re-registered known tserver with Master: 45725114cd8e466bb485f66614d9e611 (127.9.187.194:41487)
I20260808 17:41:17.747438 20114 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:46049
I20260808 17:41:17.748939 21771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.699538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:52871 (local address 127.9.187.252:34837)
0808 17:41:17.699879 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.699881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.699928 (+ 47us) server_negotiation.cc:407] Connection header received
0808 17:41:17.700558 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.700560 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.700576 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.700631 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.701347 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.702097 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.703496 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.703812 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.703874 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.706254 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.706255 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.706255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.706262 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.747889 (+ 41627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.748270 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.748271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.748271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.748335 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.748508 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.748508 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.748508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.748606 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.748654 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.748798 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.748878 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310}
I20260808 17:41:17.749202 21978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.699505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:34837 (local address 127.9.187.194:52871)
0808 17:41:17.699871 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.699880 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.700342 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.700640 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.700640 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.701014 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.701227 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.701234 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.702218 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.702219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.703414 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.703416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.703937 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.703938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.704085 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.704761 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.704765 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.706163 (+ 1398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.747980 (+ 41817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.747981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.747981 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.748182 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.748389 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.748390 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.748390 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.748455 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.748657 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.748658 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.748701 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.748779 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.748889 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":29,"thread_start_us":95,"threads_started":1}
I20260808 17:41:17.749575 21971 heartbeater.cc:347] Connected to a master server at 127.9.187.252:34837
I20260808 17:41:17.749627 21971 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:17.749702 21971 heartbeater.cc:511] Master 127.9.187.252:34837 requested a full tablet report, sending...
I20260808 17:41:17.749975 21441 ts_manager.cc:194] Registered new tserver with Master: 45725114cd8e466bb485f66614d9e611 (127.9.187.194:41487)
I20260808 17:41:17.752018 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:38385
--local_ip_for_outbound_sockets=127.9.187.195
--tserver_master_addrs=127.9.187.254:33409
--webserver_port=37023
--webserver_interface=127.9.187.195
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab
--principal=oryx/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.187.254:33409,127.9.187.253:41837
--tserver_master_addrs=127.9.187.254:33409,127.9.187.253:41837,127.9.187.252:34837 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:17.834151 21982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:17.834370 21982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:17.834394 21982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:17.835533 21982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:17.835578 21982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:17.835609 21982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:17.837074 21982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab
--principal=oryx/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:38385
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=37023
--tserver_master_addrs=127.9.187.254:33409,127.9.187.253:41837,127.9.187.252:34837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:17.837312 21982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:17.837548 21982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:17.842489 21996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:17.842499 22000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:17.842619 21993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:17.842780 21982 server_base.cc:1034] running on GCE node
I20260808 17:41:17.843035 21982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:17.843266 21982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:17.844408 21982 hybrid_clock.cc:648] HybridClock initialized: now 1786210877844390 us; error 29 us; skew 500 ppm
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:17.846769 21982 init.cc:377] Logged in from keytab as oryx/127.9.187.195@KRBTEST.COM (short username oryx)
I20260808 17:41:17.847158 21982 webserver.cc:460] Webserver started at http://127.9.187.195:37023/ using document root <none> and password file <none>
I20260808 17:41:17.847379 21982 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:17.847442 21982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:17.848686 21982 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:41:17.849229 22015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.849403 21982 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.849483 21982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "3745b05e726c42fd8665b3b7186e041e"
format_stamp: "Formatted at 2026-08-08 17:41:16 on dist-test-slave-bqcl"
server_key: "c7fc7532d773dd234f5824c363767c33"
server_key_iv: "9fa8c7a39ddf6bc4ebde13db8b424db7"
server_key_version: "encryptionkey@0"
I20260808 17:41:17.849785 21982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:17.867726 21982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:17.869618 21982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:17.869753 21982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:17.869964 21982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:17.870304 21982 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:17.870342 21982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.870368 21982 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:17.870393 21982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:17.875939 21982 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:38385
I20260808 17:41:17.875975 22202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:38385 every 8 connection(s)
I20260808 17:41:17.876331 21982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:41:17.876969 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 21982
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.252@KRBTEST.COM
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.253@KRBTEST.COM
Aug 08 17:41:17 dist-test-slave-bqcl krb5kdc[20035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210877, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:17.889195 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.878424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37376 (local address 127.9.187.252:34837)
0808 17:41:17.878664 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.878666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.879061 (+ 395us) server_negotiation.cc:407] Connection header received
0808 17:41:17.879154 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.879155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.879167 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.879205 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.879803 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.880510 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.881488 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.881774 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.881810 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.883635 (+ 1825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.883637 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.883637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.883643 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.886592 (+ 2949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.888037 (+ 1445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.888039 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.888039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.888097 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.888300 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.888301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.888301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.888423 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.888500 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.889006 (+ 506us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.889093 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":62,"threads_started":1}
I20260808 17:41:17.889770 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.877506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:57193 (local address 127.9.187.253:41837)
0808 17:41:17.877558 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.877560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.877803 (+ 243us) server_negotiation.cc:407] Connection header received
0808 17:41:17.878260 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.878261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.878272 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.878331 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.879229 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.879947 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.883189 (+ 3242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.883489 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.883535 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.886606 (+ 3071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.886607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.886608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.886614 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.888105 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.888437 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.888438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.888439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.888494 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.889052 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.889057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.889057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.889186 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.889229 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.889608 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.889675 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:41:17.890298 22212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.877317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:41837 (local address 127.9.187.195:57193)
0808 17:41:17.877730 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.877737 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.877995 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.878385 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.878386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.878726 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.879150 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.879152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.880053 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.880054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.882383 (+ 2329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.882386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.883621 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.883622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.883682 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.884282 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.884287 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.885923 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.888181 (+ 2258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.888182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.888182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.888383 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.888592 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.888593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.888593 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.888694 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.889293 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.889300 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.889456 (+ 156us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.889851 (+ 395us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.890025 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"mutex_wait_us":333,"thread_start_us":54,"threads_started":1}
I20260808 17:41:17.890803 22205 heartbeater.cc:347] Connected to a master server at 127.9.187.253:41837
I20260808 17:41:17.890901 22205 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:17.891108 22205 heartbeater.cc:511] Master 127.9.187.253:41837 requested a full tablet report, sending...
I20260808 17:41:17.891197 21771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.877463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:34999 (local address 127.9.187.252:34837)
0808 17:41:17.877861 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.877863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.877872 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:17.878153 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.878154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.878166 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.878197 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.879139 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.879917 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.881463 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.881773 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.881811 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.885059 (+ 3248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.885061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.885061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.885068 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.887668 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.888142 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.888143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.888143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.888189 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.890675 (+ 2486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.890676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.890677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.890798 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.890835 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.891034 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.891111 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":369}
I20260808 17:41:17.891486 22211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.877044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:34837 (local address 127.9.187.195:34999)
0808 17:41:17.877226 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.877277 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.877908 (+ 631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.878266 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.878270 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.878832 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.879025 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.879031 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.880155 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.880156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.881369 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.881371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.881889 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.881890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.882181 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.882765 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.882774 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.884956 (+ 2182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.887749 (+ 2793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.887756 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.887758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.888063 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.888257 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.888258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.888258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.890604 (+ 2346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.890879 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.890879 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.890918 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.891292 (+ 374us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.891384 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":4,"thread_start_us":86,"threads_started":1}
I20260808 17:41:17.891813 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.877315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:57479 (local address 127.9.187.254:33409)
0808 17:41:17.877365 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.877367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.877672 (+ 305us) server_negotiation.cc:407] Connection header received
0808 17:41:17.878037 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.878039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.878053 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.878084 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.881201 (+ 3117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.881922 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.883864 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.884143 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.884187 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.888789 (+ 4602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.888790 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.888791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.888798 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.890510 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.890975 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.890976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.890977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.891049 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.891271 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.891272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.891272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.891391 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.891445 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.891626 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.891732 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":22}
I20260808 17:41:17.891997 22226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.878114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42830 (local address 127.9.187.254:33409)
0808 17:41:17.878824 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.878826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.878832 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:41:17.878855 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.878856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.878867 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.878927 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.879653 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.880416 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.881451 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.881757 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.881810 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.884573 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.884574 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.884574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.884582 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.887385 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.888696 (+ 1311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.888697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.888697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.888758 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.888982 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.888983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.888984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.890214 (+ 1230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.891575 (+ 1361us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.891617 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.891923 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":103,"threads_started":1}
I20260808 17:41:17.892007 22213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.877044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.195:57479)
0808 17:41:17.877612 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.877622 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.877911 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.878266 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.878270 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.878749 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:17.879025 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.879031 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.882035 (+ 3004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.882035 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.883050 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.883053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.885505 (+ 2452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.885506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.885568 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.886030 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:17.886034 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:17.888529 (+ 2495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:17.890680 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.890681 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.890681 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.890883 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.891119 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:17.891120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:17.891120 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:17.891180 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:17.891478 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:17.891478 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:17.891517 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.891654 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.891748 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":6,"spinlock_wait_cycles":7552,"thread_start_us":94,"threads_started":1}
I20260808 17:41:17.892248 22203 heartbeater.cc:347] Connected to a master server at 127.9.187.252:34837
I20260808 17:41:17.892297 22203 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:17.892356 22203 heartbeater.cc:511] Master 127.9.187.252:34837 requested a full tablet report, sending...
I20260808 17:41:17.892405 21130 ts_manager.cc:194] Registered new tserver with Master: 3745b05e726c42fd8665b3b7186e041e (127.9.187.195:38385)
I20260808 17:41:17.892612 22204 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33409
I20260808 17:41:17.892658 22204 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:17.892654 21441 ts_manager.cc:194] Registered new tserver with Master: 3745b05e726c42fd8665b3b7186e041e (127.9.187.195:38385)
I20260808 17:41:17.892714 22204 heartbeater.cc:511] Master 127.9.187.254:33409 requested a full tablet report, sending...
I20260808 17:41:17.892911 20114 ts_manager.cc:194] Re-registered known tserver with Master: 3745b05e726c42fd8665b3b7186e041e (127.9.187.195:38385)
I20260808 17:41:17.893214 20114 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:57479
I20260808 17:41:17.893474 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.888810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:34837 (local address 127.0.0.1:37384)
0808 17:41:17.889254 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.889265 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.889303 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.889555 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.889556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.889558 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:17.889595 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.889596 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.890759 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.890760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.891776 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.891779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.893262 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.893263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.893321 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.893324 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.893371 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.893411 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425}
I20260808 17:41:17.893848 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.889369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37384 (local address 127.9.187.252:34837)
0808 17:41:17.889402 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.889404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.889411 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:41:17.889430 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.889430 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.889451 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.889652 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:17.889679 (+ 27us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.890591 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.892466 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.893185 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.893247 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.893322 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.893760 (+ 438us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.893798 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:41:17.894045 21459 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 17:41:17.894243 21514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70326d8a9d8547e19708870f102210ee. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.894325 21514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: This master's current role is: LEARNER
I20260808 17:41:17.895155 21219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.878148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45796 (local address 127.9.187.253:41837)
0808 17:41:17.878185 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.878186 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.878902 (+ 716us) server_negotiation.cc:407] Connection header received
0808 17:41:17.882195 (+ 3293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.882196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.882206 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.882233 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.883136 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.883823 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.885726 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.886005 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.886061 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.888147 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.888148 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.888148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.888154 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.889618 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.894388 (+ 4770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.894389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.894389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.894453 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.894668 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.894669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.894670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.894810 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.894898 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.895004 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.895079 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:41:17.895040 20114 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42830:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:41:17.896629 20114 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:41:17.897308 21067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: NON_VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: true } } }
I20260808 17:41:17.897416 21067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:17.898664 21066 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee: attempting to promote NON_VOTER 3309fa1dc71d4bf4b0ce262b0df9c638 to VOTER
I20260808 17:41:17.898844 21066 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } }
I20260808 17:41:17.899224 21459 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 LEARNER]: Refusing update from remote peer 70326d8a9d8547e19708870f102210ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 17:41:17.899281 21148 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Refusing update from remote peer 70326d8a9d8547e19708870f102210ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 17:41:17.899418 22234 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 17:41:17.899537 22234 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 17:41:17.900309 21066 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3309fa1dc71d4bf4b0ce262b0df9c638 (127.9.187.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:17.900486 21148 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3309fa1dc71d4bf4b0ce262b0df9c638 (127.9.187.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:17.900496 21459 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3309fa1dc71d4bf4b0ce262b0df9c638 (127.9.187.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:17.900990 21066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:17.901057 21066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:17.901104 21066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:17.901145 21066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:17.901183 21066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:17.901238 21066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:17.901409 21514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:17.901409 21377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "70326d8a9d8547e19708870f102210ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:17.901487 21377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:41:17.901489 21514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:41:17.906319 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.902241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:33693 (local address 127.0.0.1:39324)
0808 17:41:17.902269 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.902278 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.902312 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.902966 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.902967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.902968 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:17.902993 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.902994 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.903941 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.903942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.904616 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.904618 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.906014 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.906015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.906080 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.906084 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.906191 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.906239 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15}
I20260808 17:41:17.906497 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.902581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46642 (local address 127.9.187.195:38385)
0808 17:41:17.902765 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.902770 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.902780 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:17.902815 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.902817 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.902836 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.902915 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:17.903029 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.904002 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.905296 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.905973 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.906285 (+ 312us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.906370 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.906394 (+ 24us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.906429 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":118,"threads_started":1}
I20260808 17:41:17.906642 22243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.902330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:38385 (local address 127.0.0.1:46642)
0808 17:41:17.902543 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.902553 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.902604 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.902924 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.902925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.902927 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:17.902969 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.902970 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.904101 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.904102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.905188 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.905190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.906077 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.906078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.906164 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.906167 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.906197 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.906239 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":1,"thread_start_us":154,"threads_started":1}
I20260808 17:41:17.906679 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.902618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39324 (local address 127.9.187.193:33693)
0808 17:41:17.902802 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.902807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.902818 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:41:17.902856 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.902858 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.902870 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.903058 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:17.903113 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.903866 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.904691 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.905897 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.905985 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.906226 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.906262 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.906307 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":93,"threads_started":1}
I20260808 17:41:17.907323 22244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.902337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:41487 (local address 127.0.0.1:41656)
0808 17:41:17.902813 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.902822 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.902868 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.903139 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.903139 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.903141 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:17.903181 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.903183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.904752 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.904753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.906219 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.906222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.907067 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.907068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.907131 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.907136 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.907212 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.907253 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":158,"threads_started":1}
I20260808 17:41:17.907341 22245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.902429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41656 (local address 127.9.187.194:41487)
0808 17:41:17.902979 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.902983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.902991 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:17.903027 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.903029 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.903043 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.903249 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:17.903308 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.904659 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.906303 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.906985 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.907060 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.907130 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.907224 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.907262 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":80,"threads_started":1}
I20260808 17:41:17.907438 22093 tablet_service.cc:1467] Processing CreateTablet for tablet dfc6715837b140dc88b0fb8d3b735980 (DEFAULT_TABLE table=test-table [id=c962ba463cdf41738d6caffbb8695ee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:17.907513 21643 tablet_service.cc:1467] Processing CreateTablet for tablet dfc6715837b140dc88b0fb8d3b735980 (DEFAULT_TABLE table=test-table [id=c962ba463cdf41738d6caffbb8695ee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:17.907812 22093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfc6715837b140dc88b0fb8d3b735980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:17.907927 21643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfc6715837b140dc88b0fb8d3b735980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:17.908073 21863 tablet_service.cc:1467] Processing CreateTablet for tablet dfc6715837b140dc88b0fb8d3b735980 (DEFAULT_TABLE table=test-table [id=c962ba463cdf41738d6caffbb8695ee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:17.908432 21863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfc6715837b140dc88b0fb8d3b735980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:17.911471 22250 tablet_bootstrap.cc:492] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e: Bootstrap starting.
I20260808 17:41:17.912284 22251 tablet_bootstrap.cc:492] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: Bootstrap starting.
I20260808 17:41:17.912365 22252 tablet_bootstrap.cc:492] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Bootstrap starting.
I20260808 17:41:17.912894 22251 tablet_bootstrap.cc:654] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:17.912894 22250 tablet_bootstrap.cc:654] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:17.912904 22252 tablet_bootstrap.cc:654] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:17.913321 22251 log.cc:824] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:17.913516 22252 log.cc:824] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:17.913558 22250 log.cc:824] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:17.914234 22251 tablet_bootstrap.cc:492] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: No bootstrap required, opened a new log
I20260808 17:41:17.914309 22251 ts_tablet_manager.cc:1397] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:41:17.914321 22252 tablet_bootstrap.cc:492] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: No bootstrap required, opened a new log
I20260808 17:41:17.914373 22252 ts_tablet_manager.cc:1397] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:17.914386 22250 tablet_bootstrap.cc:492] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e: No bootstrap required, opened a new log
I20260808 17:41:17.914450 22250 ts_tablet_manager.cc:1397] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 17:41:17.916712 22250 raft_consensus.cc:348] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } }
I20260808 17:41:17.916719 22251 raft_consensus.cc:348] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } }
I20260808 17:41:17.916843 22250 raft_consensus.cc:374] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:17.916868 22251 raft_consensus.cc:374] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:17.916877 22250 raft_consensus.cc:729] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3745b05e726c42fd8665b3b7186e041e, State: Initialized, Role: FOLLOWER
I20260808 17:41:17.916911 22251 raft_consensus.cc:729] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45725114cd8e466bb485f66614d9e611, State: Initialized, Role: FOLLOWER
I20260808 17:41:17.916985 22250 consensus_queue.cc:260] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } }
I20260808 17:41:17.917239 22250 ts_tablet_manager.cc:1428] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:41:17.917232 22251 consensus_queue.cc:260] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } }
I20260808 17:41:17.917394 22204 heartbeater.cc:503] Master 127.9.187.254:33409 was elected leader, sending a full tablet report...
I20260808 17:41:17.917500 22251 ts_tablet_manager.cc:1428] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:41:17.917896 22252 raft_consensus.cc:348] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } }
I20260808 17:41:17.918037 22252 raft_consensus.cc:374] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:17.918099 22252 raft_consensus.cc:729] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a24d2e8ce02a44f9ac6b8bfe0f44d1c7, State: Initialized, Role: FOLLOWER
I20260808 17:41:17.918218 21972 heartbeater.cc:503] Master 127.9.187.254:33409 was elected leader, sending a full tablet report...
I20260808 17:41:17.919041 22252 consensus_queue.cc:260] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } }
I20260808 17:41:17.919293 22252 ts_tablet_manager.cc:1428] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260808 17:41:17.919343 21762 heartbeater.cc:503] Master 127.9.187.254:33409 was elected leader, sending a full tablet report...
W20260808 17:41:17.950049 21974 tablet.cc:2369] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:41:17.962319 22258 raft_consensus.cc:482] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:17.962431 22258 raft_consensus.cc:504] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } }
I20260808 17:41:17.962838 22258 leader_election.cc:288] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45725114cd8e466bb485f66614d9e611 (127.9.187.194:41487), 3745b05e726c42fd8665b3b7186e041e (127.9.187.195:38385)
I20260808 17:41:17.965744 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.963132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:46679 (local address 127.9.187.195:38385)
0808 17:41:17.963185 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.963187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.963195 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:17.963222 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.963223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.963246 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.963296 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:17.963459 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.963936 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.964945 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.965331 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.965392 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.965402 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.965644 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.965685 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:41:17.965790 21770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.962982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:38385 (local address 127.9.187.193:46679)
0808 17:41:17.963059 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.963077 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.963132 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.963307 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.963308 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.963309 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:17.963397 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.963399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.964009 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.964010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.964866 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.964869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.965403 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.965404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.965565 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.965569 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.965620 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.965660 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 17:41:17.965981 21768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.962991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:41487 (local address 127.9.187.193:59245)
0808 17:41:17.963150 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:17.963160 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:17.963214 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:17.963349 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:17.963367 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:17.963368 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:17.963435 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.963437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.964086 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.964087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.965005 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:17.965015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.965626 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.965627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:17.965793 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.965797 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:17.965856 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:41:17.965897 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":117}
I20260808 17:41:17.966056 22245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.963052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:59245 (local address 127.9.187.194:41487)
0808 17:41:17.963094 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.963096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.963221 (+ 125us) server_negotiation.cc:407] Connection header received
0808 17:41:17.963281 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.963282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.963291 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.963344 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:17.963496 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.964007 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.965094 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.965556 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.965618 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.965626 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.965953 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.965996 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:41:17.966082 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfc6715837b140dc88b0fb8d3b735980" candidate_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3745b05e726c42fd8665b3b7186e041e" is_pre_election: true
I20260808 17:41:17.966265 22120 raft_consensus.cc:2454] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a24d2e8ce02a44f9ac6b8bfe0f44d1c7 in term 0.
I20260808 17:41:17.966543 21569 leader_election.cc:302] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3745b05e726c42fd8665b3b7186e041e, a24d2e8ce02a44f9ac6b8bfe0f44d1c7; no voters:
I20260808 17:41:17.966689 22258 raft_consensus.cc:2781] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:41:17.966657 21894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfc6715837b140dc88b0fb8d3b735980" candidate_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45725114cd8e466bb485f66614d9e611" is_pre_election: true
I20260808 17:41:17.966740 22258 raft_consensus.cc:482] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:17.966763 22258 raft_consensus.cc:3037] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:17.966800 21894 raft_consensus.cc:2454] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a24d2e8ce02a44f9ac6b8bfe0f44d1c7 in term 0.
I20260808 17:41:17.967679 22258 raft_consensus.cc:504] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } }
I20260808 17:41:17.967799 22258 leader_election.cc:288] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [CANDIDATE]: Term 1 election: Requested vote from peers 45725114cd8e466bb485f66614d9e611 (127.9.187.194:41487), 3745b05e726c42fd8665b3b7186e041e (127.9.187.195:38385)
I20260808 17:41:17.967937 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfc6715837b140dc88b0fb8d3b735980" candidate_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3745b05e726c42fd8665b3b7186e041e"
I20260808 17:41:17.967926 21894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfc6715837b140dc88b0fb8d3b735980" candidate_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45725114cd8e466bb485f66614d9e611"
I20260808 17:41:17.968015 22120 raft_consensus.cc:3037] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:17.968084 21894 raft_consensus.cc:3037] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:17.969134 21894 raft_consensus.cc:2454] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a24d2e8ce02a44f9ac6b8bfe0f44d1c7 in term 1.
I20260808 17:41:17.969316 21572 leader_election.cc:302] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45725114cd8e466bb485f66614d9e611, a24d2e8ce02a44f9ac6b8bfe0f44d1c7; no voters:
I20260808 17:41:17.969393 22258 raft_consensus.cc:2781] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:17.969487 22120 raft_consensus.cc:2454] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a24d2e8ce02a44f9ac6b8bfe0f44d1c7 in term 1.
I20260808 17:41:17.969529 22258 raft_consensus.cc:686] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 1 LEADER]: Becoming Leader. State: Replica: a24d2e8ce02a44f9ac6b8bfe0f44d1c7, State: Running, Role: LEADER
I20260808 17:41:17.969615 22258 consensus_queue.cc:237] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } }
I20260808 17:41:17.970400 20114 catalog_manager.cc:5495] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a24d2e8ce02a44f9ac6b8bfe0f44d1c7 (127.9.187.193). New cstate: current_term: 1 leader_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } health_report { overall_health: UNKNOWN } } }
I20260808 17:41:17.976508 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.974653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39340 (local address 127.9.187.193:33693)
0808 17:41:17.974693 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.974695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.974702 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:41:17.974764 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.974765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.974779 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.974832 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:17.974924 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.975339 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.975989 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.976151 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.976189 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.976296 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:17.976378 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:17.976430 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.976444 (+ 14us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.976459 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:41:17.978439 22120 raft_consensus.cc:1261] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e [term 1 FOLLOWER]: Refusing update from remote peer a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:17.978439 21894 raft_consensus.cc:1261] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611 [term 1 FOLLOWER]: Refusing update from remote peer a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:17.978761 22261 consensus_queue.cc:1035] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:17.978888 22258 consensus_queue.cc:1035] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:17.983968 22269 mvcc.cc:205] Tried to move back new op lower bound from 7316319756197179392 to 7316319756164034560. Current Snapshot: MvccSnapshot[applied={T|T < 7316319756197179392}]
I20260808 17:41:17.984587 20114 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:17.984681 20114 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:17.985920 20114 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70326d8a9d8547e19708870f102210ee: Sending DeleteTablet for 3 replicas of tablet dfc6715837b140dc88b0fb8d3b735980
I20260808 17:41:17.986312 22093 tablet_service.cc:1514] Processing DeleteTablet for tablet dfc6715837b140dc88b0fb8d3b735980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:17 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:46642
I20260808 17:41:17.986546 22281 tablet_replica.cc:330] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e: stopping tablet replica
I20260808 17:41:17.986693 22281 raft_consensus.cc:2229] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:17.986753 21643 tablet_service.cc:1514] Processing DeleteTablet for tablet dfc6715837b140dc88b0fb8d3b735980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:17 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:39324
I20260808 17:41:17.986927 22281 raft_consensus.cc:2258] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:17.987106 21863 tablet_service.cc:1514] Processing DeleteTablet for tablet dfc6715837b140dc88b0fb8d3b735980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:17 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:41656
I20260808 17:41:17.987553 22281 ts_tablet_manager.cc:1905] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:17.987645 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 20057
I20260808 17:41:17.989486 22281 ts_tablet_manager.cc:1918] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:17.989658 22281 log.cc:1196] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/dfc6715837b140dc88b0fb8d3b735980
I20260808 17:41:17.990036 22281 ts_tablet_manager.cc:1939] T dfc6715837b140dc88b0fb8d3b735980 P 3745b05e726c42fd8665b3b7186e041e: Deleting consensus metadata
I20260808 17:41:17.990990 22288 tablet_replica.cc:330] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: stopping tablet replica
I20260808 17:41:17.991101 22288 raft_consensus.cc:2229] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:17.991189 22288 raft_consensus.cc:2258] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:17.994458 22288 ts_tablet_manager.cc:1905] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:17.996241 22288 ts_tablet_manager.cc:1918] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:17.996315 22288 log.cc:1196] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/dfc6715837b140dc88b0fb8d3b735980
I20260808 17:41:17.996572 22288 ts_tablet_manager.cc:1939] T dfc6715837b140dc88b0fb8d3b735980 P 45725114cd8e466bb485f66614d9e611: Deleting consensus metadata
I20260808 17:41:17.997648 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:17.986985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37394 (local address 127.9.187.252:34837)
0808 17:41:17.987079 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:17.987081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:17.987482 (+ 401us) server_negotiation.cc:407] Connection header received
0808 17:41:17.987590 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:17.987591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:17.987601 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:17.987631 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:17.990931 (+ 3300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.991599 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.992985 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:17.993227 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:17.993277 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:17.994790 (+ 1513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:17.994792 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:17.994792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:17.994799 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:17.996439 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.996946 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.996948 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.996948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.997008 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:17.997178 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:17.997179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:17.997179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:17.997287 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:17.997377 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:17.997482 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 17:41:17.997559 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 17:41:18.002522 22285 tablet_replica.cc:330] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: stopping tablet replica
I20260808 17:41:18.002643 22285 raft_consensus.cc:2229] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:41:18.002749 22285 raft_consensus.cc:2258] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:18.003244 22285 ts_tablet_manager.cc:1905] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:18.005321 22285 ts_tablet_manager.cc:1918] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:18.005403 22285 log.cc:1196] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-0/wal/wals/dfc6715837b140dc88b0fb8d3b735980
I20260808 17:41:18.005659 22285 ts_tablet_manager.cc:1939] T dfc6715837b140dc88b0fb8d3b735980 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Deleting consensus metadata
W20260808 17:41:18.008925 22020 connection.cc:535] server connection from 127.0.0.1:46642 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 17:41:18.008939 21795 connection.cc:535] server connection from 127.0.0.1:41656 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 17:41:18.009218 21570 connection.cc:535] server connection from 127.0.0.1:39324 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 17:41:18.017782 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:18.010775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37408 (local address 127.9.187.252:34837)
0808 17:41:18.010823 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:18.010825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:18.010966 (+ 141us) server_negotiation.cc:407] Connection header received
0808 17:41:18.011090 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:18.011091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:18.011100 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:18.011144 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:18.011866 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:18.012619 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:18.013514 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:18.013765 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:18.013833 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:18.015170 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:18.015172 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:18.015172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:18.015179 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:18.016744 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:18.017048 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:18.017049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:18.017049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:18.017107 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:18.017312 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:18.017313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:18.017313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:18.017421 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:18.017507 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:18.017611 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 17:41:18.017687 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:41:18.018411 21219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:18.010664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45806 (local address 127.9.187.253:41837)
0808 17:41:18.010723 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:18.010725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:18.010890 (+ 165us) server_negotiation.cc:407] Connection header received
0808 17:41:18.010944 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:18.010944 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:18.010956 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:18.011011 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:18.011703 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:18.012244 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:18.013307 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:18.013617 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:18.013689 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:18.015538 (+ 1849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:18.015539 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:18.015540 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:18.015548 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:18.017058 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:18.017454 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:18.017455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:18.017456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:18.017523 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:18.017717 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:18.017718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:18.017718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:18.017855 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:18.017921 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:18.018280 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 17:41:18.018350 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:41:18.982975 22301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:18.982702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.195:42365)
0808 17:41:18.982831 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:18.982916 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
W20260808 17:41:18.983204 22204 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:33409 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
I20260808 17:41:18.985074 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:18.984694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.194:42139)
0808 17:41:18.984953 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:18.985028 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":90,"threads_started":1}
I20260808 17:41:18.985306 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:18.984863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.193:33349)
0808 17:41:18.985159 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:18.985259 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":62,"threads_started":1}
W20260808 17:41:18.985343 21972 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:33409 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
W20260808 17:41:18.985488 21762 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:33409 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
I20260808 17:41:19.486423 22304 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70326d8a9d8547e19708870f102210ee)
I20260808 17:41:19.486613 22304 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } }
I20260808 17:41:19.486897 22306 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70326d8a9d8547e19708870f102210ee)
I20260808 17:41:19.486951 22304 leader_election.cc:288] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409), 3309fa1dc71d4bf4b0ce262b0df9c638 (127.9.187.252:34837)
I20260808 17:41:19.487027 22306 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } }
I20260808 17:41:19.487274 22306 leader_election.cc:288] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409), 3dc41105215b4ed3ac8143cb043c0cf8 (127.9.187.253:41837)
I20260808 17:41:19.487593 22307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.487096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43270)
0808 17:41:19.487482 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.487546 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":50,"threads_started":1}
I20260808 17:41:19.487608 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.487391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43274)
0808 17:41:19.487529 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.487574 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":49,"threads_started":1}
W20260808 17:41:19.487722 21417 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
W20260808 17:41:19.487722 21104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
I20260808 17:41:19.488154 22307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.488065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43292)
0808 17:41:19.488102 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.488126 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 17:41:19.488154 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.488065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43288)
0808 17:41:19.488102 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.488126 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 17:41:19.488250 21417 leader_election.cc:334] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409): Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
W20260808 17:41:19.488250 21104 leader_election.cc:334] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409): Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
I20260808 17:41:19.491113 22309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.487277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37410 (local address 127.9.187.252:34837)
0808 17:41:19.487596 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:19.487598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:19.487605 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:41:19.487627 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:19.487628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:19.487637 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:19.487944 (+ 307us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:19.488051 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:19.488866 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:19.490260 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:19.490789 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:19.490848 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:19.490858 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:19.490981 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 17:41:19.491019 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":48,"threads_started":1}
I20260808 17:41:19.491101 22312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.487447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45816 (local address 127.9.187.253:41837)
0808 17:41:19.487547 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:19.487548 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:19.487659 (+ 111us) server_negotiation.cc:407] Connection header received
0808 17:41:19.487679 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:19.487680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:19.487689 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:19.487747 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:19.487926 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:19.488697 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:19.490160 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:19.490713 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:19.490796 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:19.490810 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:19.490964 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 17:41:19.491012 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":86,"thread_start_us":54,"threads_started":1}
I20260808 17:41:19.491189 22308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.487133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:34837 (local address 127.0.0.1:37410)
0808 17:41:19.487387 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.487401 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:19.487464 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:19.487908 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:19.487909 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:19.487914 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:19.487989 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:19.487991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:19.488952 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:19.488953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:19.490169 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:19.490174 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:19.490861 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:19.490862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:19.490917 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:19.490921 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:19.490977 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:41:19.491039 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":35,"thread_start_us":81,"threads_started":1}
I20260808 17:41:19.491132 22310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.487393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:41837 (local address 127.0.0.1:45816)
0808 17:41:19.487549 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.487559 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:19.487614 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:19.487794 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:19.487795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:19.487797 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:19.487856 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:19.487857 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:19.488814 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:19.488815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:19.490035 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:19.490038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:19.490811 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:19.490813 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:19.490882 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:19.490888 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 17:41:19.490958 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 17:41:19.491005 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":50,"threads_started":1}
I20260808 17:41:19.491425 21459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" is_pre_election: true
I20260808 17:41:19.491526 21459 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dc41105215b4ed3ac8143cb043c0cf8 in term 1.
I20260808 17:41:19.491524 21148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" is_pre_election: true
I20260808 17:41:19.491636 21148 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3309fa1dc71d4bf4b0ce262b0df9c638 in term 1.
I20260808 17:41:19.491670 21105 leader_election.cc:302] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3309fa1dc71d4bf4b0ce262b0df9c638, 3dc41105215b4ed3ac8143cb043c0cf8; no voters: 70326d8a9d8547e19708870f102210ee
I20260808 17:41:19.491765 22304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 17:41:19.491807 22304 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70326d8a9d8547e19708870f102210ee)
I20260808 17:41:19.491827 22304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:41:19.491865 21421 leader_election.cc:302] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3309fa1dc71d4bf4b0ce262b0df9c638, 3dc41105215b4ed3ac8143cb043c0cf8; no voters: 70326d8a9d8547e19708870f102210ee
I20260808 17:41:19.491963 22306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 17:41:19.491999 22306 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70326d8a9d8547e19708870f102210ee)
I20260808 17:41:19.492022 22306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:41:19.492506 22304 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } }
I20260808 17:41:19.492604 22304 leader_election.cc:288] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 2 election: Requested vote from peers 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409), 3309fa1dc71d4bf4b0ce262b0df9c638 (127.9.187.252:34837)
I20260808 17:41:19.492681 22306 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } }
I20260808 17:41:19.492777 21459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638"
I20260808 17:41:19.492810 22308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.492714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43316)
0808 17:41:19.492762 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.492786 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 17:41:19.492863 21459 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dc41105215b4ed3ac8143cb043c0cf8 in current term 2: Already voted for candidate 3309fa1dc71d4bf4b0ce262b0df9c638 in this term.
I20260808 17:41:19.492878 22306 leader_election.cc:288] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [CANDIDATE]: Term 2 election: Requested vote from peers 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409), 3dc41105215b4ed3ac8143cb043c0cf8 (127.9.187.253:41837)
I20260808 17:41:19.493112 22308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.493015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43334)
0808 17:41:19.493058 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.493089 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 17:41:19.493160 22310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.492977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43320)
0808 17:41:19.493108 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.493138 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260808 17:41:19.493216 21148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3dc41105215b4ed3ac8143cb043c0cf8"
I20260808 17:41:19.493309 21148 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3309fa1dc71d4bf4b0ce262b0df9c638 in current term 2: Already voted for candidate 3dc41105215b4ed3ac8143cb043c0cf8 in this term.
W20260808 17:41:19.493248 21104 leader_election.cc:334] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409): Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
I20260808 17:41:19.493389 21104 leader_election.cc:302] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dc41105215b4ed3ac8143cb043c0cf8; no voters: 3309fa1dc71d4bf4b0ce262b0df9c638, 70326d8a9d8547e19708870f102210ee
I20260808 17:41:19.493453 22304 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 17:41:19.493547 22310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.493394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43350)
0808 17:41:19.493494 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.493524 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260808 17:41:19.493633 21417 leader_election.cc:334] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409): Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
I20260808 17:41:19.493678 21417 leader_election.cc:302] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3309fa1dc71d4bf4b0ce262b0df9c638; no voters: 3dc41105215b4ed3ac8143cb043c0cf8, 70326d8a9d8547e19708870f102210ee
I20260808 17:41:19.493754 22306 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 17:41:19.983814 22318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.983566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.195:59603)
0808 17:41:19.983709 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.983754 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260808 17:41:19.985890 22320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.985664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.194:40161)
0808 17:41:19.985809 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.985843 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260808 17:41:19.985924 22321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:19.985757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.193:47989)
0808 17:41:19.985850 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:19.985888 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78,"thread_start_us":47,"threads_started":1}
I20260808 17:41:20.984493 22323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:20.984262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.195:44407)
0808 17:41:20.984382 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:20.984431 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":63,"threads_started":1}
I20260808 17:41:20.986459 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:20.986283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.194:60213)
0808 17:41:20.986391 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:20.986422 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":54,"threads_started":1}
I20260808 17:41:20.986532 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:20.986283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.193:55549)
0808 17:41:20.986452 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:20.986492 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":57,"threads_started":1}
I20260808 17:41:21.690177 22328 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:21.690281 22328 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } }
I20260808 17:41:21.690464 22328 leader_election.cc:288] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409), 3309fa1dc71d4bf4b0ce262b0df9c638 (127.9.187.252:34837)
I20260808 17:41:21.690758 21459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" is_pre_election: true
I20260808 17:41:21.690858 21459 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dc41105215b4ed3ac8143cb043c0cf8 in term 2.
I20260808 17:41:21.690865 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.690669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43666)
0808 17:41:21.690783 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.690816 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":57,"threads_started":1}
I20260808 17:41:21.691032 21105 leader_election.cc:302] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3309fa1dc71d4bf4b0ce262b0df9c638, 3dc41105215b4ed3ac8143cb043c0cf8; no voters:
I20260808 17:41:21.691121 22328 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 17:41:21.691162 22328 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:21.691179 22328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 2 FOLLOWER]: Advancing to term 3
I20260808 17:41:21.691258 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.691167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43674)
0808 17:41:21.691206 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.691232 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 17:41:21.691330 21104 leader_election.cc:334] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409): Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
I20260808 17:41:21.691936 22328 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } }
I20260808 17:41:21.692047 22328 leader_election.cc:288] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 3 election: Requested vote from peers 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409), 3309fa1dc71d4bf4b0ce262b0df9c638 (127.9.187.252:34837)
I20260808 17:41:21.692278 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.692172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43684)
0808 17:41:21.692213 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.692254 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 17:41:21.692252 21459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638"
I20260808 17:41:21.692328 21459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 2 FOLLOWER]: Advancing to term 3
I20260808 17:41:21.692641 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.692521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43696)
0808 17:41:21.692564 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.692593 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 17:41:21.692744 21104 leader_election.cc:334] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409): Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
I20260808 17:41:21.693097 21459 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dc41105215b4ed3ac8143cb043c0cf8 in term 3.
I20260808 17:41:21.693284 21105 leader_election.cc:302] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3309fa1dc71d4bf4b0ce262b0df9c638, 3dc41105215b4ed3ac8143cb043c0cf8; no voters: 70326d8a9d8547e19708870f102210ee
I20260808 17:41:21.693387 22328 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 17:41:21.693504 22328 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [term 3 LEADER]: Becoming Leader. State: Replica: 3dc41105215b4ed3ac8143cb043c0cf8, State: Running, Role: LEADER
I20260808 17:41:21.693574 22328 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } }
I20260808 17:41:21.693919 22332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dc41105215b4ed3ac8143cb043c0cf8. Latest consensus state: current_term: 3 leader_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:21.694016 22332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:21.694223 22334 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:21.694700 22334 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:21.694766 22334 catalog_manager.cc:1259] Loaded cluster ID: 022ce407ad6243ef911e1cdb5508f125
I20260808 17:41:21.694787 22334 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:21.694926 22334 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:21.694976 22334 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: Loaded TSK: 0
I20260808 17:41:21.695092 22334 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:41:21.747543 21129 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:41:21.749118 21129 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:41:21.750061 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.749948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43718)
0808 17:41:21.749993 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.750032 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:41:21.750075 21459 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [term 3 FOLLOWER]: Refusing update from remote peer 3dc41105215b4ed3ac8143cb043c0cf8: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260808 17:41:21.750308 22328 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 17:41:21.750438 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.750339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.0.0.1:43724)
0808 17:41:21.750380 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.750407 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 17:41:21.750569 21104 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 -> Peer 70326d8a9d8547e19708870f102210ee (127.9.187.254:33409): Couldn't send request to peer 70326d8a9d8547e19708870f102210ee. Status: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 17:41:21.750905 22336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dc41105215b4ed3ac8143cb043c0cf8. Latest consensus state: current_term: 3 leader_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:21.750991 22336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:41:21.751382 22332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:21.751554 22336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "70326d8a9d8547e19708870f102210ee" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33409 } } peers { permanent_uuid: "3dc41105215b4ed3ac8143cb043c0cf8" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 41837 } attrs { promote: false } } peers { permanent_uuid: "3309fa1dc71d4bf4b0ce262b0df9c638" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 34837 } attrs { promote: false } } }
I20260808 17:41:21.751657 22336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3309fa1dc71d4bf4b0ce262b0df9c638 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:41:21.751704 22332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:21.756196 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.753114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:41487 (local address 127.0.0.1:41664)
0808 17:41:21.753422 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.753433 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:21.753488 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:21.753676 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:21.753677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:21.753679 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:21.753743 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:21.753744 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.754457 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.754458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:21.755289 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:21.755291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.755968 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.755969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:21.756031 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:21.756036 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:41:21.756083 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 17:41:21.756124 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":26,"thread_start_us":89,"threads_started":1}
I20260808 17:41:21.756211 22348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.753183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41664 (local address 127.9.187.194:41487)
0808 17:41:21.753312 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:21.753314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:21.753491 (+ 177us) server_negotiation.cc:407] Connection header received
0808 17:41:21.753537 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:21.753538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:21.753548 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:21.753603 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:21.753819 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.754378 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.755369 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.755882 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.755948 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:21.755961 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:21.756094 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 17:41:21.756137 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":69,"threads_started":1}
I20260808 17:41:21.756582 22344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.753082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:33693 (local address 127.0.0.1:39356)
0808 17:41:21.753271 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.753282 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:21.753333 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:21.753686 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:21.753687 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:21.753688 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:21.753742 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:21.753744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.754421 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.754422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:21.755634 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:21.755637 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.756366 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.756367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:21.756426 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:21.756429 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:21.756480 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:41:21.756519 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":37}
I20260808 17:41:21.756613 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.753189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39356 (local address 127.9.187.193:33693)
0808 17:41:21.753578 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:21.753580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:21.753589 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:21.753614 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:21.753614 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:21.753623 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:21.753685 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:21.753790 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.754350 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.755727 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.756258 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.756324 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:21.756336 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:21.756500 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 17:41:21.756549 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":64,"threads_started":1}
I20260808 17:41:21.756786 21863 tablet_service.cc:1467] Processing CreateTablet for tablet b1e12c608d7145b8b94e6996e4369fa1 (DEFAULT_TABLE table=test-table [id=5497030088ce411f9d0b9457fef0a211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:21.756922 21863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e12c608d7145b8b94e6996e4369fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:21.757421 22349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.753328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46656 (local address 127.9.187.195:38385)
0808 17:41:21.753444 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:21.753446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:21.754507 (+ 1061us) server_negotiation.cc:407] Connection header received
0808 17:41:21.754564 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:21.754565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:21.754577 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:21.754635 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:21.754724 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.755432 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.756672 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.757127 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.757181 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:21.757190 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:21.757334 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 17:41:21.757360 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":70,"threads_started":1}
I20260808 17:41:21.757432 22343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.753169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:38385 (local address 127.0.0.1:46656)
0808 17:41:21.754453 (+ 1284us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.754463 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:21.754515 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:21.754636 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:21.754636 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:21.754638 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:21.754675 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:21.754677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.755634 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.755635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:21.756576 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:21.756579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:21.757201 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:21.757202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:21.757267 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:21.757271 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:21.757330 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:41:21.757366 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1260,"thread_start_us":73,"threads_started":1}
I20260808 17:41:21.757740 22093 tablet_service.cc:1467] Processing CreateTablet for tablet b1e12c608d7145b8b94e6996e4369fa1 (DEFAULT_TABLE table=test-table [id=5497030088ce411f9d0b9457fef0a211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:21.757854 22093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e12c608d7145b8b94e6996e4369fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:21.758322 22350 tablet_bootstrap.cc:492] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611: Bootstrap starting.
I20260808 17:41:21.758373 21643 tablet_service.cc:1467] Processing CreateTablet for tablet b1e12c608d7145b8b94e6996e4369fa1 (DEFAULT_TABLE table=test-table [id=5497030088ce411f9d0b9457fef0a211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:21.758478 21643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e12c608d7145b8b94e6996e4369fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:21.758668 22350 tablet_bootstrap.cc:654] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:21.759088 22352 tablet_bootstrap.cc:492] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e: Bootstrap starting.
I20260808 17:41:21.759250 22350 tablet_bootstrap.cc:492] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611: No bootstrap required, opened a new log
I20260808 17:41:21.759301 22350 ts_tablet_manager.cc:1397] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:41:21.759425 22350 raft_consensus.cc:348] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } }
I20260808 17:41:21.759479 22350 raft_consensus.cc:374] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:21.759473 22352 tablet_bootstrap.cc:654] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:21.759508 22350 raft_consensus.cc:729] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45725114cd8e466bb485f66614d9e611, State: Initialized, Role: FOLLOWER
I20260808 17:41:21.759557 22350 consensus_queue.cc:260] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } }
I20260808 17:41:21.759706 22350 ts_tablet_manager.cc:1428] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:21.759903 22357 tablet_bootstrap.cc:492] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Bootstrap starting.
I20260808 17:41:21.760167 22359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.759896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.194:37141)
0808 17:41:21.760089 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.760125 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":82,"threads_started":1}
I20260808 17:41:21.760329 22357 tablet_bootstrap.cc:654] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:21.760533 22359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.760370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.194:49751)
0808 17:41:21.760480 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.760506 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
I20260808 17:41:21.760535 21973 heartbeater.cc:503] Master 127.9.187.253:41837 was elected leader, sending a full tablet report...
I20260808 17:41:21.761371 22352 tablet_bootstrap.cc:492] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e: No bootstrap required, opened a new log
I20260808 17:41:21.761371 22357 tablet_bootstrap.cc:492] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: No bootstrap required, opened a new log
I20260808 17:41:21.761427 22352 ts_tablet_manager.cc:1397] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:21.761427 22357 ts_tablet_manager.cc:1397] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:21.761528 22352 raft_consensus.cc:348] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } }
I20260808 17:41:21.761528 22357 raft_consensus.cc:348] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } }
I20260808 17:41:21.761592 22352 raft_consensus.cc:374] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:21.761592 22357 raft_consensus.cc:374] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:21.761619 22352 raft_consensus.cc:729] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3745b05e726c42fd8665b3b7186e041e, State: Initialized, Role: FOLLOWER
I20260808 17:41:21.761619 22357 raft_consensus.cc:729] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a24d2e8ce02a44f9ac6b8bfe0f44d1c7, State: Initialized, Role: FOLLOWER
I20260808 17:41:21.761684 22357 consensus_queue.cc:260] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } }
I20260808 17:41:21.761684 22352 consensus_queue.cc:260] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } }
I20260808 17:41:21.761870 22357 ts_tablet_manager.cc:1428] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:21.761888 22352 ts_tablet_manager.cc:1428] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:21.762390 22205 heartbeater.cc:503] Master 127.9.187.253:41837 was elected leader, sending a full tablet report...
I20260808 17:41:21.762669 22374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.762363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.193:55359)
0808 17:41:21.762599 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.762635 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":73,"threads_started":1}
I20260808 17:41:21.762785 21765 heartbeater.cc:503] Master 127.9.187.253:41837 was elected leader, sending a full tablet report...
I20260808 17:41:21.762868 22369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.762063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.195:57625)
0808 17:41:21.762794 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.762834 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":709,"thread_start_us":100,"threads_started":1}
I20260808 17:41:21.763151 22369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.763082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.195:40185)
0808 17:41:21.763110 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.763130 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260808 17:41:21.763289 22377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:21.762922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.193:55483)
0808 17:41:21.763074 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:21.763258 (+ 184us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":92,"threads_started":1}
W20260808 17:41:21.787053 21766 tablet.cc:2369] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:41:21.878959 22210 tablet.cc:2369] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:41:22.025394 22368 raft_consensus.cc:482] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:22.025494 22368 raft_consensus.cc:504] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } }
I20260808 17:41:22.025669 22368 leader_election.cc:288] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3745b05e726c42fd8665b3b7186e041e (127.9.187.195:38385), 45725114cd8e466bb485f66614d9e611 (127.9.187.194:41487)
I20260808 17:41:22.025908 21894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e12c608d7145b8b94e6996e4369fa1" candidate_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45725114cd8e466bb485f66614d9e611" is_pre_election: true
I20260808 17:41:22.025908 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e12c608d7145b8b94e6996e4369fa1" candidate_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3745b05e726c42fd8665b3b7186e041e" is_pre_election: true
I20260808 17:41:22.026024 21894 raft_consensus.cc:2454] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a24d2e8ce02a44f9ac6b8bfe0f44d1c7 in term 0.
I20260808 17:41:22.026024 22120 raft_consensus.cc:2454] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a24d2e8ce02a44f9ac6b8bfe0f44d1c7 in term 0.
I20260808 17:41:22.026214 21572 leader_election.cc:302] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45725114cd8e466bb485f66614d9e611, a24d2e8ce02a44f9ac6b8bfe0f44d1c7; no voters:
I20260808 17:41:22.026332 22368 raft_consensus.cc:2781] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:41:22.026382 22368 raft_consensus.cc:482] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:22.026401 22368 raft_consensus.cc:3037] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:22.027092 22368 raft_consensus.cc:504] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } }
I20260808 17:41:22.027226 22368 leader_election.cc:288] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [CANDIDATE]: Term 1 election: Requested vote from peers 3745b05e726c42fd8665b3b7186e041e (127.9.187.195:38385), 45725114cd8e466bb485f66614d9e611 (127.9.187.194:41487)
I20260808 17:41:22.027392 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e12c608d7145b8b94e6996e4369fa1" candidate_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3745b05e726c42fd8665b3b7186e041e"
I20260808 17:41:22.027392 21894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e12c608d7145b8b94e6996e4369fa1" candidate_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45725114cd8e466bb485f66614d9e611"
I20260808 17:41:22.027472 21894 raft_consensus.cc:3037] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:22.027472 22120 raft_consensus.cc:3037] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:22.028208 22120 raft_consensus.cc:2454] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a24d2e8ce02a44f9ac6b8bfe0f44d1c7 in term 1.
I20260808 17:41:22.028231 21894 raft_consensus.cc:2454] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a24d2e8ce02a44f9ac6b8bfe0f44d1c7 in term 1.
I20260808 17:41:22.028370 21569 leader_election.cc:302] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3745b05e726c42fd8665b3b7186e041e, a24d2e8ce02a44f9ac6b8bfe0f44d1c7; no voters:
I20260808 17:41:22.028481 22368 raft_consensus.cc:2781] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:22.028642 22368 raft_consensus.cc:686] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [term 1 LEADER]: Becoming Leader. State: Replica: a24d2e8ce02a44f9ac6b8bfe0f44d1c7, State: Running, Role: LEADER
I20260808 17:41:22.028690 22368 consensus_queue.cc:237] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } }
I20260808 17:41:22.029121 22377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:22.028851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.193:37493)
0808 17:41:22.029047 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:22.029088 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
I20260808 17:41:22.029381 21129 catalog_manager.cc:5495] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a24d2e8ce02a44f9ac6b8bfe0f44d1c7 (127.9.187.193). New cstate: current_term: 1 leader_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a24d2e8ce02a44f9ac6b8bfe0f44d1c7" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 } health_report { overall_health: UNKNOWN } } }
I20260808 17:41:22.036281 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:22.034207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39362 (local address 127.9.187.193:33693)
0808 17:41:22.034250 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:22.034252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:22.034274 (+ 22us) server_negotiation.cc:407] Connection header received
0808 17:41:22.034346 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:22.034347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:22.034356 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:22.034400 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:22.034519 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:22.034986 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:22.035703 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:22.035888 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:22.035944 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:22.036073 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:22.036104 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:22.036149 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:22.036195 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 17:41:22.036217 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:41:22.036975 21894 raft_consensus.cc:1261] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611 [term 1 FOLLOWER]: Refusing update from remote peer a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:22.037006 22120 raft_consensus.cc:1261] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e [term 1 FOLLOWER]: Refusing update from remote peer a24d2e8ce02a44f9ac6b8bfe0f44d1c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:22.037166 22378 consensus_queue.cc:1035] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45725114cd8e466bb485f66614d9e611" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:22.037286 22368 consensus_queue.cc:1035] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3745b05e726c42fd8665b3b7186e041e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:22.038190 22364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:22.037940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.194:40857)
0808 17:41:22.038083 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:22.038156 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260808 17:41:22.038444 22369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:22.038349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.195:56143)
0808 17:41:22.038392 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:22.038416 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 17:41:22.038733 22377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:22.038632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.193:52609)
0808 17:41:22.038675 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:22.038705 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:41:22.039285 22364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:22.038833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.194:58265)
0808 17:41:22.039229 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:22.039259 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381}
I20260808 17:41:22.040125 22377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:22.040044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.193:48959)
0808 17:41:22.040077 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:22.040100 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 17:41:22.040553 22369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:22.040411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33409 (local address 127.9.187.195:46841)
0808 17:41:22.040503 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:22.040528 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 17:41:22.040817 21130 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:22.040823 22387 mvcc.cc:205] Tried to move back new op lower bound from 7316319772822020096 to 7316319772790136832. Current Snapshot: MvccSnapshot[applied={T|T < 7316319772822020096}]
I20260808 17:41:22.040902 21130 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:22.041950 21130 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3dc41105215b4ed3ac8143cb043c0cf8: Sending DeleteTablet for 3 replicas of tablet b1e12c608d7145b8b94e6996e4369fa1
I20260808 17:41:22.042253 21643 tablet_service.cc:1514] Processing DeleteTablet for tablet b1e12c608d7145b8b94e6996e4369fa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:22 UTC) from {username='oryx', principal='oryx/127.9.187.253@KRBTEST.COM'} at 127.0.0.1:39356
I20260808 17:41:22.042282 21863 tablet_service.cc:1514] Processing DeleteTablet for tablet b1e12c608d7145b8b94e6996e4369fa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:22 UTC) from {username='oryx', principal='oryx/127.9.187.253@KRBTEST.COM'} at 127.0.0.1:41664
I20260808 17:41:22.042308 22093 tablet_service.cc:1514] Processing DeleteTablet for tablet b1e12c608d7145b8b94e6996e4369fa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:22 UTC) from {username='oryx', principal='oryx/127.9.187.253@KRBTEST.COM'} at 127.0.0.1:46656
I20260808 17:41:22.042475 22399 tablet_replica.cc:330] T b1e12c608d7145b8b94e6996e4369fa1 P a24d2e8ce02a44f9ac6b8bfe0f44d1c7: stopping tablet replica
I20260808 17:41:22.042624 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 21376
I20260808 17:41:22.043272 22400 tablet_replica.cc:330] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e: stopping tablet replica
I20260808 17:41:22.043326 22400 raft_consensus.cc:2229] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:22.043363 22400 raft_consensus.cc:2258] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:22.045598 22401 tablet_replica.cc:330] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611: stopping tablet replica
I20260808 17:41:22.045655 22401 raft_consensus.cc:2229] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:22.045694 22401 raft_consensus.cc:2258] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:22.050155 22400 ts_tablet_manager.cc:1905] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:22.050261 22401 ts_tablet_manager.cc:1905] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:22.051891 22400 ts_tablet_manager.cc:1918] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:22.051898 22401 ts_tablet_manager.cc:1918] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:22.051960 22401 log.cc:1196] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/b1e12c608d7145b8b94e6996e4369fa1
I20260808 17:41:22.051961 22400 log.cc:1196] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/b1e12c608d7145b8b94e6996e4369fa1
I20260808 17:41:22.052222 22401 ts_tablet_manager.cc:1939] T b1e12c608d7145b8b94e6996e4369fa1 P 45725114cd8e466bb485f66614d9e611: Deleting consensus metadata
I20260808 17:41:22.052220 22400 ts_tablet_manager.cc:1939] T b1e12c608d7145b8b94e6996e4369fa1 P 3745b05e726c42fd8665b3b7186e041e: Deleting consensus metadata
I20260808 17:41:22.052556 21109 catalog_manager.cc:4841] TS 45725114cd8e466bb485f66614d9e611 (127.9.187.194:41487): tablet b1e12c608d7145b8b94e6996e4369fa1 (table test-table [id=5497030088ce411f9d0b9457fef0a211]) successfully deleted
I20260808 17:41:22.052583 21104 catalog_manager.cc:4841] TS 3745b05e726c42fd8665b3b7186e041e (127.9.187.195:38385): tablet b1e12c608d7145b8b94e6996e4369fa1 (table test-table [id=5497030088ce411f9d0b9457fef0a211]) successfully deleted
I20260808 17:41:22.058240 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:22.058110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:33693 (local address 127.0.0.1:39372)
0808 17:41:22.058181 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:22.058212 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:33693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 17:41:22.058362 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 21772
W20260808 17:41:22.058373 21104 catalog_manager.cc:4584] TS a24d2e8ce02a44f9ac6b8bfe0f44d1c7 (127.9.187.193:33693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b1e12c608d7145b8b94e6996e4369fa1: Network error: Client connection negotiation failed: client connection to 127.9.187.193:33693: connect: Connection refused (error 111)
I20260808 17:41:22.068857 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 21982
I20260808 17:41:22.077626 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 20907
I20260808 17:41:22.089371 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 21223
2026-08-08T17:41:22Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7115 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:22 dist-test-slave-bqcl krb5kdc[22405](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:22 dist-test-slave-bqcl krb5kdc[22405](info): set up 2 sockets
Aug 08 17:41:22 dist-test-slave-bqcl krb5kdc[22405](info): commencing operation
krb5kdc: starting...
W20260808 17:41:23.252748 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:23Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.254.keytab.
Entry for principal oryx/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.254.keytab.
I20260808 17:41:23.370615 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46111
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.254.keytab
--principal=oryx/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:43303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:46111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:23.450807 22428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:23.451015 22428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:23.451037 22428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:23.452181 22428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:23.452225 22428 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 17:41:23.452239 22428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:23.452261 22428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:23.452286 22428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:23.452308 22428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:23.453845 22428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:43303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:46111
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.254.keytab
--principal=oryx/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:23.454095 22428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:23.454329 22428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:23.459295 22434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:23.459334 22441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:23.459405 22436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:23.459422 22428 server_base.cc:1034] running on GCE node
I20260808 17:41:23.459764 22428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:23.460039 22428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:23.461182 22428 hybrid_clock.cc:648] HybridClock initialized: now 1786210883461169 us; error 29 us; skew 500 ppm
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:23.463593 22428 init.cc:377] Logged in from keytab as oryx/127.9.187.254@KRBTEST.COM (short username oryx)
I20260808 17:41:23.464041 22428 webserver.cc:460] Webserver started at http://127.9.187.254:32799/ using document root <none> and password file <none>
I20260808 17:41:23.464244 22428 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:23.464293 22428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:23.464416 22428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:23.465513 22428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "c656204d6f95469bbb1dfc95a7bc7ff4"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "6c31d1b8376a13c71320d09067d5be65"
server_key_iv: "52bc0660524164b6f43dc88d8aa15081"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.465853 22428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "c656204d6f95469bbb1dfc95a7bc7ff4"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "6c31d1b8376a13c71320d09067d5be65"
server_key_iv: "52bc0660524164b6f43dc88d8aa15081"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.467160 22428 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:23.467813 22451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:23.467967 22428 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:23.468052 22428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "c656204d6f95469bbb1dfc95a7bc7ff4"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "6c31d1b8376a13c71320d09067d5be65"
server_key_iv: "52bc0660524164b6f43dc88d8aa15081"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.468125 22428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:23.475483 22428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:23.477519 22428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:23.477650 22428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:23.482112 22428 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:46111
I20260808 17:41:23.482197 22564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:46111 every 8 connection(s)
I20260808 17:41:23.482517 22428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:23.483137 22568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:23.485339 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 22428
I20260808 17:41:23.485437 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:23.485438 22568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4: Bootstrap starting.
I20260808 17:41:23.485643 9967 external_mini_cluster.cc:1428] Setting key 461bfb921d4039ed390afaba4dff944f
I20260808 17:41:23.486172 22568 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:23.486497 22568 log.cc:824] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:23.487279 22568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4: No bootstrap required, opened a new log
I20260808 17:41:23.489439 22568 raft_consensus.cc:348] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c656204d6f95469bbb1dfc95a7bc7ff4" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46111 } }
I20260808 17:41:23.489609 22568 raft_consensus.cc:374] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:23.489641 22568 raft_consensus.cc:729] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c656204d6f95469bbb1dfc95a7bc7ff4, State: Initialized, Role: FOLLOWER
I20260808 17:41:23.489765 22568 consensus_queue.cc:260] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c656204d6f95469bbb1dfc95a7bc7ff4" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46111 } }
I20260808 17:41:23.489852 22568 raft_consensus.cc:388] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:23.489894 22568 raft_consensus.cc:482] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:23.489945 22568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:23.490562 22568 raft_consensus.cc:504] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c656204d6f95469bbb1dfc95a7bc7ff4" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46111 } }
I20260808 17:41:23.490679 22568 leader_election.cc:302] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c656204d6f95469bbb1dfc95a7bc7ff4; no voters:
I20260808 17:41:23.490836 22568 leader_election.cc:288] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:23.490877 22577 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:23.491102 22577 raft_consensus.cc:686] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [term 1 LEADER]: Becoming Leader. State: Replica: c656204d6f95469bbb1dfc95a7bc7ff4, State: Running, Role: LEADER
I20260808 17:41:23.491211 22568 sys_catalog.cc:564] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:23.491238 22577 consensus_queue.cc:237] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c656204d6f95469bbb1dfc95a7bc7ff4" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46111 } }
I20260808 17:41:23.491685 22578 sys_catalog.cc:455] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c656204d6f95469bbb1dfc95a7bc7ff4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c656204d6f95469bbb1dfc95a7bc7ff4" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46111 } } }
I20260808 17:41:23.491694 22579 sys_catalog.cc:455] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c656204d6f95469bbb1dfc95a7bc7ff4. Latest consensus state: current_term: 1 leader_uuid: "c656204d6f95469bbb1dfc95a7bc7ff4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c656204d6f95469bbb1dfc95a7bc7ff4" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46111 } } }
I20260808 17:41:23.491935 22579 sys_catalog.cc:458] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:23.492306 22578 sys_catalog.cc:458] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4 [sys.catalog]: This master's current role is: LEADER
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
W20260808 17:41:23.493083 22602 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:41:23.493139 22602 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:41:23.493207 22588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:23.493414 22588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:23.494844 22588 catalog_manager.cc:1347] Generated new cluster ID: d8a5f1e6ad724dcbaac266b0fce1d9a6
I20260808 17:41:23.494892 22588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:23.496763 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.486119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55894 (local address 127.9.187.254:46111)
0808 17:41:23.486347 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:23.486355 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:23.486380 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:41:23.486863 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:23.486874 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:23.486937 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:23.487060 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:23.487845 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.488778 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.489819 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.490376 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.490464 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.493240 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:23.493244 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:23.493244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:23.493255 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:23.495195 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.495562 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.495565 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.495566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.495675 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.495857 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.495857 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.495858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.496162 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:23.496327 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:23.496405 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 17:41:23.496552 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":63,"threads_started":1}
I20260808 17:41:23.501801 22588 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:23.502380 22588 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:23.504321 22588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4: Generated new TSK 0
I20260808 17:41:23.504468 22588 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab.
Entry for principal oryx/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab.
I20260808 17:41:23.533960 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:46111
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab
--principal=oryx/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:43303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:23.615314 22614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:23.615525 22614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:23.615564 22614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:23.616690 22614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:23.616732 22614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:23.616760 22614 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:41:23.616782 22614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:23.618273 22614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:43303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab
--principal=oryx/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.187.254:46111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:23.618508 22614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:23.618721 22614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:23.623368 22621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:23.623384 22627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:23.623409 22623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:23.623603 22614 server_base.cc:1034] running on GCE node
I20260808 17:41:23.623880 22614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:23.624125 22614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:23.625280 22614 hybrid_clock.cc:648] HybridClock initialized: now 1786210883625262 us; error 34 us; skew 500 ppm
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:23.627652 22614 init.cc:377] Logged in from keytab as oryx/127.9.187.193@KRBTEST.COM (short username oryx)
I20260808 17:41:23.628047 22614 webserver.cc:460] Webserver started at http://127.9.187.193:41165/ using document root <none> and password file <none>
I20260808 17:41:23.628244 22614 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:23.628290 22614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:23.628412 22614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:23.629419 22614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "c261af81122f4a72a3f6495ef20fb5d1"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "04d75e2cbaf618d966b7b2b9aa011d4d"
server_key_iv: "96e42b137dd91d1e769a139c524f57e3"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.629741 22614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "c261af81122f4a72a3f6495ef20fb5d1"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "04d75e2cbaf618d966b7b2b9aa011d4d"
server_key_iv: "96e42b137dd91d1e769a139c524f57e3"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.630975 22614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:41:23.631629 22639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:23.631778 22614 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:23.631858 22614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "c261af81122f4a72a3f6495ef20fb5d1"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "04d75e2cbaf618d966b7b2b9aa011d4d"
server_key_iv: "96e42b137dd91d1e769a139c524f57e3"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.631914 22614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:23.650995 22614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:23.652827 22614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:23.652956 22614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:23.653416 22614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:23.653457 22614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:23.653486 22614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:23.653503 22614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:23.659624 22614 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:39821
I20260808 17:41:23.659767 22836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:39821 every 8 connection(s)
I20260808 17:41:23.660009 22614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:23.662938 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.653867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:54205 (local address 127.9.187.254:46111)
0808 17:41:23.653916 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:23.653918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:23.654155 (+ 237us) server_negotiation.cc:407] Connection header received
0808 17:41:23.654692 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:23.654693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:23.654707 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:23.654774 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:23.655607 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.656416 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.657927 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.658281 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.658364 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.660755 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:23.660757 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:23.660758 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:23.660765 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:23.661828 (+ 1063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.662223 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.662224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.662224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.662270 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.662448 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.662448 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.662448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.662561 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:23.662608 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:23.662808 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 17:41:23.662876 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:41:23.663100 22653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.653860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46111 (local address 127.9.187.193:54205)
0808 17:41:23.654002 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:23.654038 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:23.654587 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:23.654854 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:23.654857 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:23.655182 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:23.655466 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.655471 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.656538 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.656539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.657837 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.657840 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.658375 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.658376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.658521 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.659060 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:23.659070 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:23.660659 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:23.661891 (+ 1232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.661897 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.661899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.662157 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.662312 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.662312 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.662312 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.662408 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.662606 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:23.662609 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:23.662714 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 17:41:23.662793 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 17:41:23.662906 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":78,"threads_started":1}
I20260808 17:41:23.663543 22837 heartbeater.cc:347] Connected to a master server at 127.9.187.254:46111
I20260808 17:41:23.663627 22837 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:23.663830 22837 heartbeater.cc:511] Master 127.9.187.254:46111 requested a full tablet report, sending...
I20260808 17:41:23.664366 22483 ts_manager.cc:194] Registered new tserver with Master: c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821)
I20260808 17:41:23.665030 22483 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:54205
I20260808 17:41:23.669278 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 22614
I20260808 17:41:23.669378 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:23.669488 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.664606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:39679 (local address 127.9.187.254:46111)
0808 17:41:23.664640 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:23.664642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:23.664761 (+ 119us) server_negotiation.cc:407] Connection header received
0808 17:41:23.664816 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:23.664817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:23.664827 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:23.664871 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:23.665232 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.665802 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.666528 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.666734 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.666792 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.667500 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:23.667502 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:23.667502 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:23.667508 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:23.668487 (+ 979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.668787 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.668788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.668789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.668840 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.669018 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.669019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.669019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.669143 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:23.669198 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:23.669339 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 17:41:23.669403 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:41:23.669497 22846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.664564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46111 (local address 127.9.187.193:39679)
0808 17:41:23.664689 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:23.664699 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:23.664763 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:23.664876 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:23.664876 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:23.665039 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:23.665083 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.665085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.665899 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.665900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.666455 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.666458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.666801 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.666801 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.666859 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.667173 (+ 314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:23.667176 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:23.667422 (+ 246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:23.668562 (+ 1140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.668563 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.668563 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.668727 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.668903 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.668904 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.668904 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.668960 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.669202 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:23.669203 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:23.669248 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 17:41:23.669308 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 17:41:23.669405 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
I20260808 17:41:23.669590 9967 external_mini_cluster.cc:1428] Setting key 2efd740690dc32f34c9d9893802b3767
WARNING: no policy specified for oryx/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab.
Entry for principal oryx/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab.
I20260808 17:41:23.692984 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:46111
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab
--principal=oryx/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:43303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:23.774025 22851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:23.774250 22851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:23.774276 22851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:23.775401 22851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:23.775447 22851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:23.775471 22851 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:41:23.775514 22851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:23.777019 22851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:43303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab
--principal=oryx/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.187.254:46111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:23.777247 22851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:23.777460 22851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:23.782191 22864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:23.782214 22861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:23.782408 22851 server_base.cc:1034] running on GCE node
W20260808 17:41:23.782191 22866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:23.782647 22851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:23.782841 22851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:23.783973 22851 hybrid_clock.cc:648] HybridClock initialized: now 1786210883783958 us; error 30 us; skew 500 ppm
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:23.786433 22851 init.cc:377] Logged in from keytab as oryx/127.9.187.194@KRBTEST.COM (short username oryx)
I20260808 17:41:23.786862 22851 webserver.cc:460] Webserver started at http://127.9.187.194:36795/ using document root <none> and password file <none>
I20260808 17:41:23.787070 22851 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:23.787113 22851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:23.787235 22851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:23.788188 22851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "b89dbec6a2e7469996db74314623e0af"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "9b662357479b30f00b0bc43558d1b19b"
server_key_iv: "b36e1874c3d917c86d63380353849872"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.788499 22851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "b89dbec6a2e7469996db74314623e0af"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "9b662357479b30f00b0bc43558d1b19b"
server_key_iv: "b36e1874c3d917c86d63380353849872"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.789690 22851 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:23.790414 22873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:23.790565 22851 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:23.790642 22851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "b89dbec6a2e7469996db74314623e0af"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "9b662357479b30f00b0bc43558d1b19b"
server_key_iv: "b36e1874c3d917c86d63380353849872"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.790707 22851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:23.811093 22851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:23.813061 22851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:23.813187 22851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:23.813668 22851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:23.813709 22851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:23.813736 22851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:23.813760 22851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:23.820327 22851 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:33529
I20260808 17:41:23.820451 23043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:33529 every 8 connection(s)
I20260808 17:41:23.820700 22851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:41:23.822692 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.813976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:45831 (local address 127.9.187.254:46111)
0808 17:41:23.814029 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:23.814031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:23.814262 (+ 231us) server_negotiation.cc:407] Connection header received
0808 17:41:23.814711 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:23.814712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:23.814725 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:23.814780 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:23.815403 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.815896 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.816957 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.817206 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.817275 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.820154 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:23.820155 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:23.820156 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:23.820163 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:23.821506 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.821940 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.821941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.821941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.821989 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.822212 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.822212 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.822212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.822323 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:23.822373 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:23.822574 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 17:41:23.822629 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:41:23.822824 22889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.813968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46111 (local address 127.9.187.194:45831)
0808 17:41:23.814114 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:23.814180 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:23.814622 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:23.814850 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:23.814854 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:23.815134 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:23.815316 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.815321 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.815977 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.815978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.816862 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.816864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.817280 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.817281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.817431 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.817909 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:23.817920 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:23.820048 (+ 2128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:23.821596 (+ 1548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.821601 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.821602 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.821878 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.822026 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.822026 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.822027 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.822154 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.822371 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:23.822374 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:23.822479 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 17:41:23.822555 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 17:41:23.822669 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260808 17:41:23.823331 23044 heartbeater.cc:347] Connected to a master server at 127.9.187.254:46111
I20260808 17:41:23.823417 23044 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:23.823593 23044 heartbeater.cc:511] Master 127.9.187.254:46111 requested a full tablet report, sending...
I20260808 17:41:23.823941 22481 ts_manager.cc:194] Registered new tserver with Master: b89dbec6a2e7469996db74314623e0af (127.9.187.194:33529)
I20260808 17:41:23.824299 22481 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:45831
I20260808 17:41:23.827219 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 22851
I20260808 17:41:23.827339 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:23.827553 9967 external_mini_cluster.cc:1428] Setting key b14c097d6db11ada2121ee1f72fb9bb1
I20260808 17:41:23.829403 23054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.824216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46111 (local address 127.9.187.194:47647)
0808 17:41:23.824336 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:23.824346 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:23.824424 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:23.824585 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:23.824586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:23.824734 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:23.824790 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.824791 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.825548 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.825549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.826034 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.826035 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.826367 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.826368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.826412 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.826766 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:23.826771 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:23.827019 (+ 248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:23.828528 (+ 1509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.828529 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.828529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.828682 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.828866 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.828866 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.828866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.828911 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.829183 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:23.829183 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:23.829215 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 17:41:23.829269 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 17:41:23.829338 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":73,"threads_started":1}
I20260808 17:41:23.829443 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.824282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:47647 (local address 127.9.187.254:46111)
0808 17:41:23.824322 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:23.824323 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:23.824398 (+ 75us) server_negotiation.cc:407] Connection header received
0808 17:41:23.824487 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:23.824488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:23.824498 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:23.824568 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:23.824846 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.825475 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.826089 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.826315 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.826363 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.827087 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:23.827088 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:23.827088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:23.827094 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:23.828457 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.828744 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.828745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.828745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.828807 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.828955 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.828956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.828956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.829129 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:23.829193 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:23.829298 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 17:41:23.829369 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for oryx/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab.
Entry for principal oryx/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab.
I20260808 17:41:23.852227 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:46111
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab
--principal=oryx/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:43303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:23.934551 23057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:23.934911 23057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:23.934953 23057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:23.936609 23057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:23.936650 23057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:23.936681 23057 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:41:23.936700 23057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:23.938246 23057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:43303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab
--principal=oryx/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.187.254:46111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:23.939527 23057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:23.939759 23057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:23.944923 23063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:23.944911 23064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:23.944962 23066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:23.945217 23057 server_base.cc:1034] running on GCE node
I20260808 17:41:23.945402 23057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:23.945629 23057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:23.946772 23057 hybrid_clock.cc:648] HybridClock initialized: now 1786210883946757 us; error 28 us; skew 500 ppm
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:23.949163 23057 init.cc:377] Logged in from keytab as oryx/127.9.187.195@KRBTEST.COM (short username oryx)
I20260808 17:41:23.949587 23057 webserver.cc:460] Webserver started at http://127.9.187.195:40829/ using document root <none> and password file <none>
I20260808 17:41:23.949780 23057 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:23.949827 23057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:23.949951 23057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:23.951004 23057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "fc39708682fb412e8d74f11d02349a74"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "d916854642def7e383a0731069447a28"
server_key_iv: "a2fe1b248153fbe1c5886d60331b8afb"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.951339 23057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "fc39708682fb412e8d74f11d02349a74"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "d916854642def7e383a0731069447a28"
server_key_iv: "a2fe1b248153fbe1c5886d60331b8afb"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.952551 23057 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:23.953169 23081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:23.953331 23057 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:23.953413 23057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "fc39708682fb412e8d74f11d02349a74"
format_stamp: "Formatted at 2026-08-08 17:41:23 on dist-test-slave-bqcl"
server_key: "d916854642def7e383a0731069447a28"
server_key_iv: "a2fe1b248153fbe1c5886d60331b8afb"
server_key_version: "encryptionkey@0"
I20260808 17:41:23.953477 23057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:23.964000 23057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:23.965852 23057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:23.966082 23057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:23.966660 23057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:23.966701 23057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:23.966730 23057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:23.966755 23057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:23.973511 23057 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:44371
I20260808 17:41:23.973623 23259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:44371 every 8 connection(s)
I20260808 17:41:23.973874 23057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:41:23.976141 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.967037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:40405 (local address 127.9.187.254:46111)
0808 17:41:23.967103 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:23.967106 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:23.967282 (+ 176us) server_negotiation.cc:407] Connection header received
0808 17:41:23.967732 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:23.967734 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:23.967747 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:23.967829 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:23.968608 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.969395 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.970806 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.971110 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.971189 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.973583 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:23.973584 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:23.973585 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:23.973593 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:23.975066 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.975414 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.975415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.975415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.975469 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.975652 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.975652 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.975653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.975763 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:23.975817 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:23.976016 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 17:41:23.976079 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 17:41:23.976289 23099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.966994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46111 (local address 127.9.187.195:40405)
0808 17:41:23.967135 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:23.967174 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:23.967638 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:23.967906 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:23.967910 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:23.968220 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:23.968503 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.968509 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.969497 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.969498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.970733 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.970736 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.971204 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.971205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.971337 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.971786 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:23.971795 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:23.973460 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:23.975143 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.975146 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.975148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.975351 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.975521 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.975522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.975522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.975606 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.975813 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:23.975816 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:23.975916 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 17:41:23.975986 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 17:41:23.976105 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":75,"threads_started":1}
I20260808 17:41:23.976706 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 23057
I20260808 17:41:23.976800 23260 heartbeater.cc:347] Connected to a master server at 127.9.187.254:46111
I20260808 17:41:23.976830 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:23.976888 23260 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:23.977061 9967 external_mini_cluster.cc:1428] Setting key f33caf6c68f4ddc9a98a593a436e5002
I20260808 17:41:23.977190 23260 heartbeater.cc:511] Master 127.9.187.254:46111 requested a full tablet report, sending...
I20260808 17:41:23.977543 22483 ts_manager.cc:194] Registered new tserver with Master: fc39708682fb412e8d74f11d02349a74 (127.9.187.195:44371)
I20260808 17:41:23.978031 22483 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:40405
I20260808 17:41:23.978471 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:41:23.983062 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.977840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:36921 (local address 127.9.187.254:46111)
0808 17:41:23.977906 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:23.977908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:23.977962 (+ 54us) server_negotiation.cc:407] Connection header received
0808 17:41:23.978004 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:23.978005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:23.978014 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:23.978071 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:23.978585 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.979041 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.979722 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.979962 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.980033 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.980856 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:23.980857 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:23.980857 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:23.980864 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:23.982074 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.982395 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.982396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.982397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.982451 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:23.982610 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:23.982610 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:23.982611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:23.982712 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:23.982773 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:23.982914 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 17:41:23.982975 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 17:41:23.983080 23268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:23.977790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46111 (local address 127.9.187.195:36921)
0808 17:41:23.977910 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:23.977920 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:23.977969 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:23.978074 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:23.978075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:23.978410 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:23.978473 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.978476 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.979129 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.979130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.979648 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:23.979649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.980055 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.980056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:23.980122 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:23.980501 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:23.980505 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:23.980764 (+ 259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:23.982166 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.982167 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.982167 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.982335 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.982503 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:23.982504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:23.982504 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:23.982561 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:23.982773 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:23.982774 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:23.982817 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 17:41:23.982882 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 17:41:23.982975 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":70,"threads_started":1}
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:23 dist-test-slave-bqcl krb5kdc[22405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 17:41:24.000141 22572 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:23.995690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55898 (local address 127.9.187.254:46111)
0808 17:41:23.995746 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:23.995748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:23.995756 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:23.995795 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:23.995796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:23.995804 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:23.995848 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:23.996344 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.996799 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.997453 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:23.997621 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:23.997662 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.000067 (+ 2405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55898: BlockingRecv error: recv got EOF from 127.0.0.1:55898 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 17:41:24 dist-test-slave-bqcl krb5kdc[22405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:24.006484 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.000847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55906 (local address 127.9.187.254:46111)
0808 17:41:24.000904 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.000906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.000934 (+ 28us) server_negotiation.cc:407] Connection header received
0808 17:41:24.000998 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.000999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.001006 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.001048 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:24.001449 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.001884 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.002511 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.002694 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.002739 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.004552 (+ 1813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:24.004553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:24.004553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:24.004559 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:24.005631 (+ 1072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:24.005906 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:24.005907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:24.005907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:24.005949 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:24.006067 (+ 118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:24.006067 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:24.006067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:24.006223 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:24.006296 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.006377 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.006429 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:41:24.007772 22481 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:41:24.009231 22481 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:41:24.015193 23299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.011294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:39821 (local address 127.0.0.1:59582)
0808 17:41:24.011611 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:24.011622 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:24.011680 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:24.011883 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:24.011887 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:24.011889 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:24.011951 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.011953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.012929 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.012930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.014076 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.014079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.014904 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.014905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.014990 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.015005 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 17:41:24.015071 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 17:41:24.015123 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":4,"thread_start_us":62,"threads_started":1}
I20260808 17:41:24.015232 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.011414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59582 (local address 127.9.187.193:39821)
0808 17:41:24.011588 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.011592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.011735 (+ 143us) server_negotiation.cc:407] Connection header received
0808 17:41:24.011778 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.011780 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.011794 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.011859 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:24.012056 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.012852 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.014226 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.014832 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.014893 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.014972 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.015095 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.015139 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":70,"threads_started":1}
I20260808 17:41:24.015359 23289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.011483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:44371 (local address 127.0.0.1:40834)
0808 17:41:24.011697 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:24.011706 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:24.011751 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:24.011981 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:24.011982 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:24.011984 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:24.012081 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.012083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.013320 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.013321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.014218 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.014221 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.015122 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.015123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.015185 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.015189 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:24.015238 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 17:41:24.015278 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":35,"thread_start_us":86,"threads_started":1}
I20260808 17:41:24.015646 23300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.011680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40834 (local address 127.9.187.195:44371)
0808 17:41:24.011847 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.011851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.011860 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:24.011891 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.011893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.011907 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.011986 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:24.012165 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.013226 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.014287 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.014947 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.015015 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.015085 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.015509 (+ 424us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.015553 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":78,"threads_started":1}
I20260808 17:41:24.015758 23287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.011294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:33529 (local address 127.0.0.1:34976)
0808 17:41:24.011446 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:24.011483 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:24.011541 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:24.011890 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:24.011891 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:24.011894 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:24.011962 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.011964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.013317 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.013318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.014424 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.014427 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.015545 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.015546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.015609 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.015613 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:24.015661 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 17:41:24.015697 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":28,"thread_start_us":54,"threads_started":1}
I20260808 17:41:24.016053 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.011402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34976 (local address 127.9.187.194:33529)
0808 17:41:24.011662 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.011665 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.011676 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:41:24.011713 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.011716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.011745 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.011820 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:24.012104 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.013215 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.014508 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.015201 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.015427 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.015517 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.015913 (+ 396us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.015956 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":89,"threads_started":1}
I20260808 17:41:24.016077 22725 tablet_service.cc:1467] Processing CreateTablet for tablet 0536eb0e2fa948cbb206b6c354402d0a (DEFAULT_TABLE table=test-table [id=4fdbd22f75ee4ccfaf1613b8bfa2dbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.016320 23159 tablet_service.cc:1467] Processing CreateTablet for tablet 0536eb0e2fa948cbb206b6c354402d0a (DEFAULT_TABLE table=test-table [id=4fdbd22f75ee4ccfaf1613b8bfa2dbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.016459 22725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0536eb0e2fa948cbb206b6c354402d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.016660 23159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0536eb0e2fa948cbb206b6c354402d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.016647 22948 tablet_service.cc:1467] Processing CreateTablet for tablet 0536eb0e2fa948cbb206b6c354402d0a (DEFAULT_TABLE table=test-table [id=4fdbd22f75ee4ccfaf1613b8bfa2dbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.016930 22948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0536eb0e2fa948cbb206b6c354402d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.020457 23302 tablet_bootstrap.cc:492] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1: Bootstrap starting.
I20260808 17:41:24.020527 23303 tablet_bootstrap.cc:492] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af: Bootstrap starting.
I20260808 17:41:24.020690 23301 tablet_bootstrap.cc:492] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74: Bootstrap starting.
I20260808 17:41:24.021027 23302 tablet_bootstrap.cc:654] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.021204 23303 tablet_bootstrap.cc:654] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.021251 23301 tablet_bootstrap.cc:654] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.021333 23302 log.cc:824] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:24.021535 23303 log.cc:824] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:24.021546 23301 log.cc:824] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:24.022114 23302 tablet_bootstrap.cc:492] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1: No bootstrap required, opened a new log
I20260808 17:41:24.022217 23302 ts_tablet_manager.cc:1397] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:41:24.022351 23301 tablet_bootstrap.cc:492] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74: No bootstrap required, opened a new log
I20260808 17:41:24.022411 23301 ts_tablet_manager.cc:1397] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:24.022568 23303 tablet_bootstrap.cc:492] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af: No bootstrap required, opened a new log
I20260808 17:41:24.022639 23303 ts_tablet_manager.cc:1397] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:24.024004 23301 raft_consensus.cc:348] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } }
I20260808 17:41:24.024159 23301 raft_consensus.cc:374] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.024202 23301 raft_consensus.cc:729] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc39708682fb412e8d74f11d02349a74, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.024121 23302 raft_consensus.cc:348] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } }
I20260808 17:41:24.024271 23302 raft_consensus.cc:374] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.024314 23302 raft_consensus.cc:729] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c261af81122f4a72a3f6495ef20fb5d1, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.024328 23301 consensus_queue.cc:260] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } }
I20260808 17:41:24.024435 23302 consensus_queue.cc:260] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } }
I20260808 17:41:24.024607 23301 ts_tablet_manager.cc:1428] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:41:24.024636 23260 heartbeater.cc:503] Master 127.9.187.254:46111 was elected leader, sending a full tablet report...
I20260808 17:41:24.024703 23302 ts_tablet_manager.cc:1428] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:41:24.024629 23303 raft_consensus.cc:348] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } }
I20260808 17:41:24.024765 23303 raft_consensus.cc:374] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.024797 23303 raft_consensus.cc:729] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b89dbec6a2e7469996db74314623e0af, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.024847 22837 heartbeater.cc:503] Master 127.9.187.254:46111 was elected leader, sending a full tablet report...
I20260808 17:41:24.024899 23303 consensus_queue.cc:260] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } }
I20260808 17:41:24.025137 23303 ts_tablet_manager.cc:1428] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:41:24.025175 23044 heartbeater.cc:503] Master 127.9.187.254:46111 was elected leader, sending a full tablet report...
I20260808 17:41:24.044246 23319 raft_consensus.cc:482] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:24.044322 23319 raft_consensus.cc:504] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } }
I20260808 17:41:24.044559 23319 leader_election.cc:288] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc39708682fb412e8d74f11d02349a74 (127.9.187.195:44371), c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821)
I20260808 17:41:24.047237 23300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.044787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:52583 (local address 127.9.187.195:44371)
0808 17:41:24.044836 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.044838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.044846 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:24.044867 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.044868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.044876 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.044932 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:24.045077 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.045526 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.046587 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.046928 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.046989 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.046996 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.047149 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.047177 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:41:24.047258 22889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.044699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:44371 (local address 127.9.187.194:52583)
0808 17:41:24.044742 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:24.044752 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:24.044789 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:24.044944 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:24.044945 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:24.044947 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:24.045001 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.045003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.045615 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.045616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.046504 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.046506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.046997 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.046998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.047084 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.047087 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:24.047133 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:41:24.047175 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 17:41:24.047322 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.044799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:39465 (local address 127.9.187.193:39821)
0808 17:41:24.044838 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.044840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.044934 (+ 94us) server_negotiation.cc:407] Connection header received
0808 17:41:24.044972 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.044972 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.044981 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.045026 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:24.045167 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.045612 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.046675 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.047020 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.047080 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.047088 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.047228 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.047261 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:41:24.047402 23320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.044700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:39821 (local address 127.9.187.194:39465)
0808 17:41:24.044875 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:24.044883 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:24.044924 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:24.045033 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:24.045035 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:24.045046 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:24.045111 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.045112 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.045679 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.045680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.046594 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.046597 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.047093 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.047094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.047167 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.047171 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:24.047216 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:41:24.047261 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":49,"thread_start_us":86,"threads_started":1}
I20260808 17:41:24.047667 23189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0536eb0e2fa948cbb206b6c354402d0a" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc39708682fb412e8d74f11d02349a74" is_pre_election: true
I20260808 17:41:24.047708 22747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0536eb0e2fa948cbb206b6c354402d0a" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261af81122f4a72a3f6495ef20fb5d1" is_pre_election: true
I20260808 17:41:24.047796 23189 raft_consensus.cc:2454] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 0.
I20260808 17:41:24.047802 22747 raft_consensus.cc:2454] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 0.
I20260808 17:41:24.048027 22883 leader_election.cc:302] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b89dbec6a2e7469996db74314623e0af, fc39708682fb412e8d74f11d02349a74; no voters:
I20260808 17:41:24.048158 23319 raft_consensus.cc:2781] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:41:24.048215 23319 raft_consensus.cc:482] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:24.048245 23319 raft_consensus.cc:3037] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.049122 23319 raft_consensus.cc:504] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } }
I20260808 17:41:24.049240 23319 leader_election.cc:288] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 election: Requested vote from peers fc39708682fb412e8d74f11d02349a74 (127.9.187.195:44371), c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821)
I20260808 17:41:24.049377 22747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0536eb0e2fa948cbb206b6c354402d0a" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261af81122f4a72a3f6495ef20fb5d1"
I20260808 17:41:24.049393 23189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0536eb0e2fa948cbb206b6c354402d0a" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc39708682fb412e8d74f11d02349a74"
I20260808 17:41:24.049444 22747 raft_consensus.cc:3037] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.049453 23189 raft_consensus.cc:3037] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.050045 23189 raft_consensus.cc:2454] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 1.
I20260808 17:41:24.050068 22747 raft_consensus.cc:2454] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 1.
I20260808 17:41:24.050231 22878 leader_election.cc:302] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b89dbec6a2e7469996db74314623e0af, c261af81122f4a72a3f6495ef20fb5d1; no voters:
I20260808 17:41:24.050324 23319 raft_consensus.cc:2781] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:24.050469 23319 raft_consensus.cc:686] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 1 LEADER]: Becoming Leader. State: Replica: b89dbec6a2e7469996db74314623e0af, State: Running, Role: LEADER
I20260808 17:41:24.050552 23319 consensus_queue.cc:237] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } }
I20260808 17:41:24.051261 22481 catalog_manager.cc:5495] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af reported cstate change: term changed from 0 to 1, leader changed from <none> to b89dbec6a2e7469996db74314623e0af (127.9.187.194). New cstate: current_term: 1 leader_uuid: "b89dbec6a2e7469996db74314623e0af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260808 17:41:24.059561 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.057354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34992 (local address 127.9.187.194:33529)
0808 17:41:24.057392 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.057394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.057405 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:41:24.057478 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.057479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.057496 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.057556 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:24.057686 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.058147 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.058865 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.059049 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.059103 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.059271 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:24.059363 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:24.059428 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.059477 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.059496 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:41:24.061187 23189 raft_consensus.cc:1261] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Refusing update from remote peer b89dbec6a2e7469996db74314623e0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:24.061209 22747 raft_consensus.cc:1261] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Refusing update from remote peer b89dbec6a2e7469996db74314623e0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:24.061520 23319 consensus_queue.cc:1035] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:24.061662 23321 consensus_queue.cc:1035] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:24.064877 23334 mvcc.cc:205] Tried to move back new op lower bound from 7316319781112066048 to 7316319781071642624. Current Snapshot: MvccSnapshot[applied={T|T < 7316319781112066048}]
I20260808 17:41:24.066138 22483 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:24.066231 22483 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:24.066929 22483 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4: Sending DeleteTablet for 3 replicas of tablet 0536eb0e2fa948cbb206b6c354402d0a
I20260808 17:41:24.067226 22725 tablet_service.cc:1514] Processing DeleteTablet for tablet 0536eb0e2fa948cbb206b6c354402d0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:24 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:59582
I20260808 17:41:24.067313 22948 tablet_service.cc:1514] Processing DeleteTablet for tablet 0536eb0e2fa948cbb206b6c354402d0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:24 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:34976
I20260808 17:41:24.067459 22483 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 17:41:24.067528 23159 tablet_service.cc:1514] Processing DeleteTablet for tablet 0536eb0e2fa948cbb206b6c354402d0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:24 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:40834
W20260808 17:41:24.067606 22483 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:41:24.067950 23345 tablet_replica.cc:330] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1: stopping tablet replica
I20260808 17:41:24.068105 23346 tablet_replica.cc:330] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af: stopping tablet replica
I20260808 17:41:24.068192 23346 raft_consensus.cc:2229] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:41:24.068312 23346 raft_consensus.cc:2258] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:24.068529 23345 raft_consensus.cc:2229] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:24.068804 22725 tablet_service.cc:1467] Processing CreateTablet for tablet 1bf3077a81ac42a7a782920de35b4124 (DEFAULT_TABLE table=test-table [id=d9eb79d03ea647c28d0326eeff0485c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.068872 22948 tablet_service.cc:1467] Processing CreateTablet for tablet 1bf3077a81ac42a7a782920de35b4124 (DEFAULT_TABLE table=test-table [id=d9eb79d03ea647c28d0326eeff0485c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.068943 22725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bf3077a81ac42a7a782920de35b4124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.068953 22948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bf3077a81ac42a7a782920de35b4124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.070274 23302 tablet_bootstrap.cc:492] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1: Bootstrap starting.
I20260808 17:41:24.070294 23303 tablet_bootstrap.cc:492] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af: Bootstrap starting.
I20260808 17:41:24.068800 23345 raft_consensus.cc:2258] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:24.070719 23302 tablet_bootstrap.cc:654] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.070720 23303 tablet_bootstrap.cc:654] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.070256 23159 tablet_service.cc:1467] Processing CreateTablet for tablet 1bf3077a81ac42a7a782920de35b4124 (DEFAULT_TABLE table=test-table [id=d9eb79d03ea647c28d0326eeff0485c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.071376 23345 ts_tablet_manager.cc:1905] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:24.071391 23159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bf3077a81ac42a7a782920de35b4124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.072834 23301 tablet_bootstrap.cc:492] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74: Bootstrap starting.
I20260808 17:41:24.068045 23347 tablet_replica.cc:330] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74: stopping tablet replica
I20260808 17:41:24.073024 23347 raft_consensus.cc:2229] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:24.073068 23302 tablet_bootstrap.cc:492] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1: No bootstrap required, opened a new log
I20260808 17:41:24.073105 23302 ts_tablet_manager.cc:1397] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 17:41:24.073143 23347 raft_consensus.cc:2258] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:24.073244 23302 raft_consensus.cc:348] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.073304 23302 raft_consensus.cc:374] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.073298 23301 tablet_bootstrap.cc:654] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.073325 23302 raft_consensus.cc:729] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c261af81122f4a72a3f6495ef20fb5d1, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.073369 23302 consensus_queue.cc:260] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.073451 23302 ts_tablet_manager.cc:1428] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:24.073638 23346 ts_tablet_manager.cc:1905] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:24.073907 23345 ts_tablet_manager.cc:1918] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:24.074026 23345 log.cc:1196] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/wal/wals/0536eb0e2fa948cbb206b6c354402d0a
I20260808 17:41:24.074369 23345 ts_tablet_manager.cc:1939] T 0536eb0e2fa948cbb206b6c354402d0a P c261af81122f4a72a3f6495ef20fb5d1: Deleting consensus metadata
I20260808 17:41:24.074438 23301 tablet_bootstrap.cc:492] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74: No bootstrap required, opened a new log
I20260808 17:41:24.074494 23301 ts_tablet_manager.cc:1397] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:24.074632 23301 raft_consensus.cc:348] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.074719 23301 raft_consensus.cc:374] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.074754 23301 raft_consensus.cc:729] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc39708682fb412e8d74f11d02349a74, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.074795 23301 consensus_queue.cc:260] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.074882 23301 ts_tablet_manager.cc:1428] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:24.075124 23346 ts_tablet_manager.cc:1918] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:24.075139 22457 catalog_manager.cc:4841] TS c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821): tablet 0536eb0e2fa948cbb206b6c354402d0a (table test-table [id=4fdbd22f75ee4ccfaf1613b8bfa2dbf4]) successfully deleted
I20260808 17:41:24.075196 23346 log.cc:1196] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/0536eb0e2fa948cbb206b6c354402d0a
I20260808 17:41:24.075449 23346 ts_tablet_manager.cc:1939] T 0536eb0e2fa948cbb206b6c354402d0a P b89dbec6a2e7469996db74314623e0af: Deleting consensus metadata
I20260808 17:41:24.075804 22459 catalog_manager.cc:4841] TS b89dbec6a2e7469996db74314623e0af (127.9.187.194:33529): tablet 0536eb0e2fa948cbb206b6c354402d0a (table test-table [id=4fdbd22f75ee4ccfaf1613b8bfa2dbf4]) successfully deleted
I20260808 17:41:24.075980 23347 ts_tablet_manager.cc:1905] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:24.077289 23347 ts_tablet_manager.cc:1918] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:24.077361 23347 log.cc:1196] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/0536eb0e2fa948cbb206b6c354402d0a
I20260808 17:41:24.077597 23303 tablet_bootstrap.cc:492] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af: No bootstrap required, opened a new log
I20260808 17:41:24.077651 23303 ts_tablet_manager.cc:1397] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260808 17:41:24.077667 23347 ts_tablet_manager.cc:1939] T 0536eb0e2fa948cbb206b6c354402d0a P fc39708682fb412e8d74f11d02349a74: Deleting consensus metadata
I20260808 17:41:24.077819 23303 raft_consensus.cc:348] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.077877 23303 raft_consensus.cc:374] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.077896 23303 raft_consensus.cc:729] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b89dbec6a2e7469996db74314623e0af, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.077953 23303 consensus_queue.cc:260] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.078039 23303 ts_tablet_manager.cc:1428] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:24.078037 22459 catalog_manager.cc:4841] TS fc39708682fb412e8d74f11d02349a74 (127.9.187.195:44371): tablet 0536eb0e2fa948cbb206b6c354402d0a (table test-table [id=4fdbd22f75ee4ccfaf1613b8bfa2dbf4]) successfully deleted
I20260808 17:41:24.119329 23313 raft_consensus.cc:482] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:24.119426 23313 raft_consensus.cc:504] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.119743 23313 leader_election.cc:288] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821), b89dbec6a2e7469996db74314623e0af (127.9.187.194:33529)
I20260808 17:41:24.123064 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.120077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:59673 (local address 127.9.187.194:33529)
0808 17:41:24.120150 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.120151 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.120160 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:24.120641 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.120642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.120653 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.120698 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:24.120892 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.121428 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.122402 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.122744 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.122806 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.122814 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.122960 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.122993 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 17:41:24.123066 23099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.119896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:33529 (local address 127.9.187.195:59673)
0808 17:41:24.119951 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:24.119962 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:24.120560 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:24.120751 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:24.120752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:24.120753 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:24.120818 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.120820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.121508 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.121509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.122324 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.122326 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.122812 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.122813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.122899 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.122902 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:24.122946 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 17:41:24.122993 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 17:41:24.123340 22978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bf3077a81ac42a7a782920de35b4124" candidate_uuid: "fc39708682fb412e8d74f11d02349a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89dbec6a2e7469996db74314623e0af" is_pre_election: true
I20260808 17:41:24.123458 22978 raft_consensus.cc:2454] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc39708682fb412e8d74f11d02349a74 in term 0.
I20260808 17:41:24.123626 23087 leader_election.cc:302] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b89dbec6a2e7469996db74314623e0af, fc39708682fb412e8d74f11d02349a74; no voters:
I20260808 17:41:24.123744 23313 raft_consensus.cc:2781] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:41:24.123780 23313 raft_consensus.cc:482] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:24.123804 23313 raft_consensus.cc:3037] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.124130 23351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.119903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:39821 (local address 127.9.187.195:37947)
0808 17:41:24.120238 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:24.120248 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:24.120340 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:24.120628 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:24.120629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:24.120632 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:24.120737 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.120739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.121730 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.121731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.122895 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.122898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.123851 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.123852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.123927 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.123931 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:24.123987 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:41:24.124026 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"mutex_wait_us":13,"thread_start_us":82,"threads_started":1}
I20260808 17:41:24.124135 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.119996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:37947 (local address 127.9.187.193:39821)
0808 17:41:24.120038 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.120040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.120309 (+ 269us) server_negotiation.cc:407] Connection header received
0808 17:41:24.120440 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.120442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.120454 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.120553 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:24.120845 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.121627 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.123004 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.123546 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.123595 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.123604 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.124026 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.124070 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:41:24.124501 22747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bf3077a81ac42a7a782920de35b4124" candidate_uuid: "fc39708682fb412e8d74f11d02349a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261af81122f4a72a3f6495ef20fb5d1" is_pre_election: true
I20260808 17:41:24.124603 22747 raft_consensus.cc:2454] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc39708682fb412e8d74f11d02349a74 in term 0.
I20260808 17:41:24.124696 23313 raft_consensus.cc:504] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.124850 23313 leader_election.cc:288] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [CANDIDATE]: Term 1 election: Requested vote from peers c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821), b89dbec6a2e7469996db74314623e0af (127.9.187.194:33529)
I20260808 17:41:24.124980 22747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bf3077a81ac42a7a782920de35b4124" candidate_uuid: "fc39708682fb412e8d74f11d02349a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261af81122f4a72a3f6495ef20fb5d1"
I20260808 17:41:24.125056 22747 raft_consensus.cc:3037] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.125651 22747 raft_consensus.cc:2454] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc39708682fb412e8d74f11d02349a74 in term 1.
I20260808 17:41:24.125764 22978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bf3077a81ac42a7a782920de35b4124" candidate_uuid: "fc39708682fb412e8d74f11d02349a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89dbec6a2e7469996db74314623e0af"
I20260808 17:41:24.125841 22978 raft_consensus.cc:3037] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.125841 23086 leader_election.cc:302] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c261af81122f4a72a3f6495ef20fb5d1, fc39708682fb412e8d74f11d02349a74; no voters:
I20260808 17:41:24.126446 22978 raft_consensus.cc:2454] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc39708682fb412e8d74f11d02349a74 in term 1.
I20260808 17:41:24.126534 23313 raft_consensus.cc:2781] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:24.126688 23313 raft_consensus.cc:686] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 1 LEADER]: Becoming Leader. State: Replica: fc39708682fb412e8d74f11d02349a74, State: Running, Role: LEADER
I20260808 17:41:24.126770 23313 consensus_queue.cc:237] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.127445 22483 catalog_manager.cc:5495] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc39708682fb412e8d74f11d02349a74 (127.9.187.195). New cstate: current_term: 1 leader_uuid: "fc39708682fb412e8d74f11d02349a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } health_report { overall_health: HEALTHY } } }
W20260808 17:41:24.160765 22839 tablet.cc:2369] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 17:41:24 dist-test-slave-bqcl krb5kdc[22405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210883, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.254@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:24.165759 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.158812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55916 (local address 127.9.187.254:46111)
0808 17:41:24.158861 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.158863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.158989 (+ 126us) server_negotiation.cc:407] Connection header received
0808 17:41:24.159042 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.159043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.159053 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.159096 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:24.159547 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.160031 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.160786 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.161079 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.161176 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.163467 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:24.163468 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:24.163469 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:24.163475 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:24.164736 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:24.165144 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:24.165145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:24.165145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:24.165190 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:24.165360 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:24.165361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:24.165361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:24.165451 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:24.165493 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.165630 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.165693 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:41:24.165885 23364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.158774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46111 (local address 127.0.0.1:55916)
0808 17:41:24.158922 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:24.158931 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:24.158993 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:24.159115 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:24.159116 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:24.159418 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:24.159468 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.159471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.160099 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.160100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.160681 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.160684 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.161176 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.161177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.161227 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.161762 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:24.161765 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:24.163387 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:24.164814 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:24.164820 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:24.164822 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:24.165073 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:24.165238 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:24.165238 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:24.165239 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:24.165311 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:24.165494 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:24.165499 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:24.165548 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 17:41:24.165614 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 17:41:24.165758 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":40,"thread_start_us":86,"threads_started":1}
I20260808 17:41:24.167801 22483 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:55916:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 17:41:24.168030 22483 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:41:24.170629 22725 tablet_service.cc:1467] Processing CreateTablet for tablet 390f9259468b4b28b7be4b50f9b224c8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8595b3fe6cc64dc8bb5de428681cfbfc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:41:24.170789 22725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 390f9259468b4b28b7be4b50f9b224c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.172104 23302 tablet_bootstrap.cc:492] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1: Bootstrap starting.
I20260808 17:41:24.172310 22948 tablet_service.cc:1467] Processing CreateTablet for tablet 390f9259468b4b28b7be4b50f9b224c8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8595b3fe6cc64dc8bb5de428681cfbfc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:41:24.172363 23159 tablet_service.cc:1467] Processing CreateTablet for tablet 390f9259468b4b28b7be4b50f9b224c8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8595b3fe6cc64dc8bb5de428681cfbfc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:41:24.172465 22948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 390f9259468b4b28b7be4b50f9b224c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.172490 23159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 390f9259468b4b28b7be4b50f9b224c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.172508 23302 tablet_bootstrap.cc:654] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.173791 23301 tablet_bootstrap.cc:492] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: Bootstrap starting.
I20260808 17:41:24.174204 23301 tablet_bootstrap.cc:654] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.174423 23302 tablet_bootstrap.cc:492] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1: No bootstrap required, opened a new log
I20260808 17:41:24.174468 23302 ts_tablet_manager.cc:1397] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:24.174556 23303 tablet_bootstrap.cc:492] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af: Bootstrap starting.
I20260808 17:41:24.174609 23302 raft_consensus.cc:348] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.174675 23302 raft_consensus.cc:374] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.174695 23302 raft_consensus.cc:729] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c261af81122f4a72a3f6495ef20fb5d1, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.174736 23302 consensus_queue.cc:260] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.174834 23302 ts_tablet_manager.cc:1428] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:24.174852 23303 tablet_bootstrap.cc:654] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.174891 23315 tablet_replica.cc:439] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } }
I20260808 17:41:24.174983 23315 tablet_replica.cc:442] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:41:24.175349 23303 tablet_bootstrap.cc:492] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af: No bootstrap required, opened a new log
I20260808 17:41:24.175400 23303 ts_tablet_manager.cc:1397] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:41:24.175498 23303 raft_consensus.cc:348] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.175555 23303 raft_consensus.cc:374] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.175567 23303 raft_consensus.cc:729] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b89dbec6a2e7469996db74314623e0af, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.175599 23303 consensus_queue.cc:260] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.175678 23303 ts_tablet_manager.cc:1428] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:24.175714 23319 tablet_replica.cc:439] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } }
I20260808 17:41:24.175808 23319 tablet_replica.cc:442] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:41:24.176088 23301 tablet_bootstrap.cc:492] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: No bootstrap required, opened a new log
I20260808 17:41:24.176143 23301 ts_tablet_manager.cc:1397] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 17:41:24.176486 23301 raft_consensus.cc:348] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.176545 23301 raft_consensus.cc:374] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.176558 23301 raft_consensus.cc:729] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc39708682fb412e8d74f11d02349a74, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.176591 23301 consensus_queue.cc:260] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.176680 23301 ts_tablet_manager.cc:1428] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 17:41:24.176741 23313 tablet_replica.cc:439] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } }
I20260808 17:41:24.176816 23313 tablet_replica.cc:442] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 17:41:24.224442 23261 tablet.cc:2369] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:41:24.312803 23313 raft_consensus.cc:482] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:24.312906 23313 raft_consensus.cc:504] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.313060 23313 leader_election.cc:288] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821), b89dbec6a2e7469996db74314623e0af (127.9.187.194:33529)
I20260808 17:41:24.313268 22978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f9259468b4b28b7be4b50f9b224c8" candidate_uuid: "fc39708682fb412e8d74f11d02349a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89dbec6a2e7469996db74314623e0af" is_pre_election: true
I20260808 17:41:24.313282 22747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f9259468b4b28b7be4b50f9b224c8" candidate_uuid: "fc39708682fb412e8d74f11d02349a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261af81122f4a72a3f6495ef20fb5d1" is_pre_election: true
I20260808 17:41:24.313361 22978 raft_consensus.cc:2454] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc39708682fb412e8d74f11d02349a74 in term 0.
I20260808 17:41:24.313393 22747 raft_consensus.cc:2454] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc39708682fb412e8d74f11d02349a74 in term 0.
I20260808 17:41:24.313513 23087 leader_election.cc:302] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b89dbec6a2e7469996db74314623e0af, fc39708682fb412e8d74f11d02349a74; no voters:
I20260808 17:41:24.313616 23313 raft_consensus.cc:2781] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:41:24.313670 23313 raft_consensus.cc:482] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:24.313688 23313 raft_consensus.cc:3037] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.314451 23313 raft_consensus.cc:504] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.314570 23313 leader_election.cc:288] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [CANDIDATE]: Term 1 election: Requested vote from peers c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821), b89dbec6a2e7469996db74314623e0af (127.9.187.194:33529)
I20260808 17:41:24.314755 22747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f9259468b4b28b7be4b50f9b224c8" candidate_uuid: "fc39708682fb412e8d74f11d02349a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261af81122f4a72a3f6495ef20fb5d1"
I20260808 17:41:24.314738 22978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f9259468b4b28b7be4b50f9b224c8" candidate_uuid: "fc39708682fb412e8d74f11d02349a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89dbec6a2e7469996db74314623e0af"
I20260808 17:41:24.314826 22978 raft_consensus.cc:3037] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.314826 22747 raft_consensus.cc:3037] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.315547 22747 raft_consensus.cc:2454] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc39708682fb412e8d74f11d02349a74 in term 1.
I20260808 17:41:24.315604 22978 raft_consensus.cc:2454] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc39708682fb412e8d74f11d02349a74 in term 1.
I20260808 17:41:24.315744 23086 leader_election.cc:302] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c261af81122f4a72a3f6495ef20fb5d1, fc39708682fb412e8d74f11d02349a74; no voters:
I20260808 17:41:24.315840 23313 raft_consensus.cc:2781] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:24.315892 23313 raft_consensus.cc:686] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [term 1 LEADER]: Becoming Leader. State: Replica: fc39708682fb412e8d74f11d02349a74, State: Running, Role: LEADER
I20260808 17:41:24.315948 23313 consensus_queue.cc:237] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.316277 23354 tablet_replica.cc:439] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: TxnStatusTablet state changed. Reason: New leader fc39708682fb412e8d74f11d02349a74. Latest consensus state: current_term: 1 leader_uuid: "fc39708682fb412e8d74f11d02349a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } }
I20260808 17:41:24.316370 23354 tablet_replica.cc:442] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:41:24.316603 23370 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 17:41:24.316632 22483 catalog_manager.cc:5495] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc39708682fb412e8d74f11d02349a74 (127.9.187.195). New cstate: current_term: 1 leader_uuid: "fc39708682fb412e8d74f11d02349a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } health_report { overall_health: HEALTHY } } }
I20260808 17:41:24.316709 23370 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260808 17:41:24.321270 23045 tablet.cc:2369] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:41:24.354810 23300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.352096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40848 (local address 127.9.187.195:44371)
0808 17:41:24.352143 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.352145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.352205 (+ 60us) server_negotiation.cc:407] Connection header received
0808 17:41:24.352302 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.352303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.352320 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.352380 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:24.352531 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.352998 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.354058 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.354273 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.354319 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.354518 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:24.354616 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:24.354668 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.354729 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.354748 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:41:24.354867 23364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.352049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:44371 (local address 127.0.0.1:40848)
0808 17:41:24.352149 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:24.352159 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:24.352214 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:24.352396 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:24.352397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:24.352398 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:41:24.352473 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.352476 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.353059 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.353060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.353983 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.353987 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.354329 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.354330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.354414 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.354432 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:41:24.354669 (+ 237us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:41:24.354675 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 17:41:24.354726 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:41:24.354780 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 17:41:24.356050 22747 raft_consensus.cc:1261] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Refusing update from remote peer fc39708682fb412e8d74f11d02349a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:24.356083 22978 raft_consensus.cc:1261] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Refusing update from remote peer fc39708682fb412e8d74f11d02349a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:24.356360 23354 consensus_queue.cc:1035] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:24.356492 23313 consensus_queue.cc:1035] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:24.357077 23315 tablet_replica.cc:439] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1: TxnStatusTablet state changed. Reason: New leader fc39708682fb412e8d74f11d02349a74. Latest consensus state: current_term: 1 leader_uuid: "fc39708682fb412e8d74f11d02349a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } }
I20260808 17:41:24.357096 23319 tablet_replica.cc:439] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af: TxnStatusTablet state changed. Reason: New leader fc39708682fb412e8d74f11d02349a74. Latest consensus state: current_term: 1 leader_uuid: "fc39708682fb412e8d74f11d02349a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } }
I20260808 17:41:24.357172 23315 tablet_replica.cc:442] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:41:24.357177 23319 tablet_replica.cc:442] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:41:24.357786 23313 tablet_replica.cc:439] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc39708682fb412e8d74f11d02349a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } }
I20260808 17:41:24.357868 23313 tablet_replica.cc:442] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:41:24.357893 23354 tablet_replica.cc:439] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc39708682fb412e8d74f11d02349a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } }
I20260808 17:41:24.357929 23335 mvcc.cc:205] Tried to move back new op lower bound from 7316319782320201728 to 7316319782158458880. Current Snapshot: MvccSnapshot[applied={T|T < 7316319782320201728 or (T in {7316319782320201728})}]
I20260808 17:41:24.357970 23354 tablet_replica.cc:442] T 390f9259468b4b28b7be4b50f9b224c8 P fc39708682fb412e8d74f11d02349a74: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:41:24.357971 23331 mvcc.cc:205] Tried to move back new op lower bound from 7316319782320201728 to 7316319782158458880. Current Snapshot: MvccSnapshot[applied={T|T < 7316319782320201728}]
I20260808 17:41:24.358081 23319 tablet_replica.cc:439] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc39708682fb412e8d74f11d02349a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } }
I20260808 17:41:24.358172 23319 tablet_replica.cc:442] T 390f9259468b4b28b7be4b50f9b224c8 P b89dbec6a2e7469996db74314623e0af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:41:24.358960 23315 tablet_replica.cc:439] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc39708682fb412e8d74f11d02349a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } } }
I20260808 17:41:24.359043 23315 tablet_replica.cc:442] T 390f9259468b4b28b7be4b50f9b224c8 P c261af81122f4a72a3f6495ef20fb5d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:41:24.361825 23300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.359512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40850 (local address 127.9.187.195:44371)
0808 17:41:24.359557 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.359558 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.359565 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:41:24.359584 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.359585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.359594 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.359642 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:24.359812 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.360274 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.361316 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.361481 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.361522 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.361660 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:24.361683 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:24.361713 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.361765 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.361778 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:41:24.366560 23300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.364154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:53083 (local address 127.9.187.195:44371)
0808 17:41:24.364186 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.364188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.364221 (+ 33us) server_negotiation.cc:407] Connection header received
0808 17:41:24.364291 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.364292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.364300 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.364339 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:24.364463 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.364901 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.365974 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.366174 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.366214 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.366372 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:24.366394 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:24.366421 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.366482 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.366496 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 17:41:24.366632 23268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.364111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:44371 (local address 127.9.187.195:53083)
0808 17:41:24.364182 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:24.364191 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:24.364234 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:24.364357 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:24.364357 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:24.364358 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:41:24.364412 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.364413 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.364965 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.364966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.365903 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:24.365906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.366220 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.366221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:24.366284 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.366298 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:41:24.366436 (+ 138us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:41:24.366437 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:41:24.366480 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:41:24.366519 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 17:41:24.368474 22978 raft_consensus.cc:1261] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Refusing update from remote peer fc39708682fb412e8d74f11d02349a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:24.368605 22747 raft_consensus.cc:1261] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Refusing update from remote peer fc39708682fb412e8d74f11d02349a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:24.368665 23313 consensus_queue.cc:1035] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:24.368806 23313 consensus_queue.cc:1035] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:24.379809 22483 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:24.379910 22483 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:24.380528 22483 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4: Sending DeleteTablet for 3 replicas of tablet 1bf3077a81ac42a7a782920de35b4124
I20260808 17:41:24.380781 22948 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bf3077a81ac42a7a782920de35b4124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:24 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:34976
I20260808 17:41:24.380795 23158 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bf3077a81ac42a7a782920de35b4124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:24 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:40834
I20260808 17:41:24.380892 22725 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bf3077a81ac42a7a782920de35b4124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:24 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:59582
I20260808 17:41:24.380992 23346 tablet_replica.cc:330] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af: stopping tablet replica
I20260808 17:41:24.381069 23346 raft_consensus.cc:2229] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:24.381114 23346 raft_consensus.cc:2258] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:24.381181 23347 tablet_replica.cc:330] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74: stopping tablet replica
I20260808 17:41:24.381240 23347 raft_consensus.cc:2229] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:41:24.381322 23347 raft_consensus.cc:2258] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:24.381412 23345 tablet_replica.cc:330] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1: stopping tablet replica
I20260808 17:41:24.381475 23345 raft_consensus.cc:2229] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:24.381515 23345 raft_consensus.cc:2258] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:24.381815 23345 ts_tablet_manager.cc:1905] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:24.382428 23347 ts_tablet_manager.cc:1905] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:24.383404 23345 ts_tablet_manager.cc:1918] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:41:24.383457 23345 log.cc:1196] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/wal/wals/1bf3077a81ac42a7a782920de35b4124
I20260808 17:41:24.383654 23345 ts_tablet_manager.cc:1939] T 1bf3077a81ac42a7a782920de35b4124 P c261af81122f4a72a3f6495ef20fb5d1: Deleting consensus metadata
I20260808 17:41:24.383908 23347 ts_tablet_manager.cc:1918] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:41:24.383966 23347 log.cc:1196] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/1bf3077a81ac42a7a782920de35b4124
I20260808 17:41:24.384167 23347 ts_tablet_manager.cc:1939] T 1bf3077a81ac42a7a782920de35b4124 P fc39708682fb412e8d74f11d02349a74: Deleting consensus metadata
I20260808 17:41:24.384423 23346 ts_tablet_manager.cc:1905] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:24.384562 22457 catalog_manager.cc:4841] TS c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821): tablet 1bf3077a81ac42a7a782920de35b4124 (table test-table [id=d9eb79d03ea647c28d0326eeff0485c5]) successfully deleted
I20260808 17:41:24.384641 22459 catalog_manager.cc:4841] TS fc39708682fb412e8d74f11d02349a74 (127.9.187.195:44371): tablet 1bf3077a81ac42a7a782920de35b4124 (table test-table [id=d9eb79d03ea647c28d0326eeff0485c5]) successfully deleted
I20260808 17:41:24.385862 23346 ts_tablet_manager.cc:1918] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:41:24.385911 23346 log.cc:1196] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/1bf3077a81ac42a7a782920de35b4124
I20260808 17:41:24.386096 23346 ts_tablet_manager.cc:1939] T 1bf3077a81ac42a7a782920de35b4124 P b89dbec6a2e7469996db74314623e0af: Deleting consensus metadata
I20260808 17:41:24.386513 22459 catalog_manager.cc:4841] TS b89dbec6a2e7469996db74314623e0af (127.9.187.194:33529): tablet 1bf3077a81ac42a7a782920de35b4124 (table test-table [id=d9eb79d03ea647c28d0326eeff0485c5]) successfully deleted
Aug 08 17:41:24 dist-test-slave-bqcl krb5kdc[22405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 17:41:24 dist-test-slave-bqcl krb5kdc[22405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:24 dist-test-slave-bqcl krb5kdc[22405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 17:41:24.406376 22572 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:24.400546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55924 (local address 127.9.187.254:46111)
0808 17:41:24.400609 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.400611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.400756 (+ 145us) server_negotiation.cc:407] Connection header received
0808 17:41:24.400830 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.400831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.400840 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.400886 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:24.401577 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.402073 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.403130 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.403312 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.403358 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.406314 (+ 2956us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55924: BlockingRecv error: recv got EOF from 127.0.0.1:55924 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 17:41:24 dist-test-slave-bqcl krb5kdc[22405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM
I20260808 17:41:24.413913 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.407230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55930 (local address 127.9.187.254:46111)
0808 17:41:24.407270 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.407272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.407280 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:24.407320 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.407321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.407328 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.407371 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:24.407923 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.408354 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.409324 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.409486 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.409525 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.411723 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:24.411725 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:24.411725 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:24.411737 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:24.412919 (+ 1182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:24.413296 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:24.413297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:24.413297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:24.413344 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:24.413531 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:24.413532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:24.413532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:24.413616 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:24.413685 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.413808 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.413857 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 17:41:24.415303 22483 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:41:24.415477 22483 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:41:24.416713 22725 tablet_service.cc:1467] Processing CreateTablet for tablet a7ebcd7a88d54ab2ae9715125661c2af (DEFAULT_TABLE table=test-table [id=d377a5e89fe44a5eadf2e8039dd9a27d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.416848 22725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7ebcd7a88d54ab2ae9715125661c2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.416822 22948 tablet_service.cc:1467] Processing CreateTablet for tablet a7ebcd7a88d54ab2ae9715125661c2af (DEFAULT_TABLE table=test-table [id=d377a5e89fe44a5eadf2e8039dd9a27d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.416860 23158 tablet_service.cc:1467] Processing CreateTablet for tablet a7ebcd7a88d54ab2ae9715125661c2af (DEFAULT_TABLE table=test-table [id=d377a5e89fe44a5eadf2e8039dd9a27d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.416920 22948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7ebcd7a88d54ab2ae9715125661c2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.416978 23158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7ebcd7a88d54ab2ae9715125661c2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.418179 23303 tablet_bootstrap.cc:492] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af: Bootstrap starting.
I20260808 17:41:24.418216 23302 tablet_bootstrap.cc:492] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1: Bootstrap starting.
I20260808 17:41:24.418403 23301 tablet_bootstrap.cc:492] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74: Bootstrap starting.
I20260808 17:41:24.418542 23303 tablet_bootstrap.cc:654] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.418555 23302 tablet_bootstrap.cc:654] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.418784 23301 tablet_bootstrap.cc:654] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.419466 23303 tablet_bootstrap.cc:492] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af: No bootstrap required, opened a new log
I20260808 17:41:24.419464 23301 tablet_bootstrap.cc:492] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74: No bootstrap required, opened a new log
I20260808 17:41:24.419514 23301 ts_tablet_manager.cc:1397] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 17:41:24.419515 23303 ts_tablet_manager.cc:1397] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:41:24.419621 23303 raft_consensus.cc:348] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.419684 23303 raft_consensus.cc:374] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.419657 23301 raft_consensus.cc:348] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.419703 23303 raft_consensus.cc:729] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b89dbec6a2e7469996db74314623e0af, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.419716 23301 raft_consensus.cc:374] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.419742 23301 raft_consensus.cc:729] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc39708682fb412e8d74f11d02349a74, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.419742 23303 consensus_queue.cc:260] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.419781 23301 consensus_queue.cc:260] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.419826 23303 ts_tablet_manager.cc:1428] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:24.419865 23301 ts_tablet_manager.cc:1428] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:24.420504 23302 tablet_bootstrap.cc:492] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1: No bootstrap required, opened a new log
I20260808 17:41:24.420557 23302 ts_tablet_manager.cc:1397] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:24.420706 23302 raft_consensus.cc:348] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.420763 23302 raft_consensus.cc:374] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.420780 23302 raft_consensus.cc:729] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c261af81122f4a72a3f6495ef20fb5d1, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.420822 23302 consensus_queue.cc:260] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.420913 23302 ts_tablet_manager.cc:1428] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:24.574455 23319 raft_consensus.cc:482] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:24.574553 23319 raft_consensus.cc:504] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.574709 23319 leader_election.cc:288] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821), fc39708682fb412e8d74f11d02349a74 (127.9.187.195:44371)
I20260808 17:41:24.574930 23189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7ebcd7a88d54ab2ae9715125661c2af" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc39708682fb412e8d74f11d02349a74" is_pre_election: true
I20260808 17:41:24.574949 22747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7ebcd7a88d54ab2ae9715125661c2af" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261af81122f4a72a3f6495ef20fb5d1" is_pre_election: true
I20260808 17:41:24.575024 23189 raft_consensus.cc:2454] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 0.
I20260808 17:41:24.575059 22747 raft_consensus.cc:2454] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 0.
I20260808 17:41:24.575186 22883 leader_election.cc:302] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b89dbec6a2e7469996db74314623e0af, fc39708682fb412e8d74f11d02349a74; no voters:
I20260808 17:41:24.575297 23319 raft_consensus.cc:2781] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:41:24.575345 23319 raft_consensus.cc:482] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:24.575358 23319 raft_consensus.cc:3037] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.576004 23319 raft_consensus.cc:504] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.576118 23319 leader_election.cc:288] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 election: Requested vote from peers c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821), fc39708682fb412e8d74f11d02349a74 (127.9.187.195:44371)
I20260808 17:41:24.576287 22747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7ebcd7a88d54ab2ae9715125661c2af" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261af81122f4a72a3f6495ef20fb5d1"
I20260808 17:41:24.576301 23189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7ebcd7a88d54ab2ae9715125661c2af" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc39708682fb412e8d74f11d02349a74"
I20260808 17:41:24.576373 22747 raft_consensus.cc:3037] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.576395 23189 raft_consensus.cc:3037] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.577011 22747 raft_consensus.cc:2454] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 1.
I20260808 17:41:24.577036 23189 raft_consensus.cc:2454] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 1.
I20260808 17:41:24.577196 22878 leader_election.cc:302] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b89dbec6a2e7469996db74314623e0af, c261af81122f4a72a3f6495ef20fb5d1, fc39708682fb412e8d74f11d02349a74; no voters:
I20260808 17:41:24.577304 23319 raft_consensus.cc:2781] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:24.577445 23319 raft_consensus.cc:686] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 1 LEADER]: Becoming Leader. State: Replica: b89dbec6a2e7469996db74314623e0af, State: Running, Role: LEADER
I20260808 17:41:24.577507 23319 consensus_queue.cc:237] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.578051 22483 catalog_manager.cc:5495] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af reported cstate change: term changed from 0 to 1, leader changed from <none> to b89dbec6a2e7469996db74314623e0af (127.9.187.194). New cstate: current_term: 1 leader_uuid: "b89dbec6a2e7469996db74314623e0af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } health_report { overall_health: UNKNOWN } } }
I20260808 17:41:24.600903 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:24.598790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34996 (local address 127.9.187.194:33529)
0808 17:41:24.598844 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:24.598846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:24.598854 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:24.598903 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:24.598904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:24.598915 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:24.598965 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:24.599090 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.599557 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.600299 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:24.600485 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:24.600540 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:24.600682 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:24.600715 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:24.600756 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:24.600813 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 17:41:24.600836 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:41:24.601540 22747 raft_consensus.cc:1261] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Refusing update from remote peer b89dbec6a2e7469996db74314623e0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:24.601538 23189 raft_consensus.cc:1261] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Refusing update from remote peer b89dbec6a2e7469996db74314623e0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:24.601756 23404 consensus_queue.cc:1035] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:24.601877 23319 consensus_queue.cc:1035] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:24.604087 22481 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:24.604162 22481 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:24.604708 22481 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4: Sending DeleteTablet for 3 replicas of tablet a7ebcd7a88d54ab2ae9715125661c2af
I20260808 17:41:24.604960 23158 tablet_service.cc:1514] Processing DeleteTablet for tablet a7ebcd7a88d54ab2ae9715125661c2af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:24 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:40834
I20260808 17:41:24.604979 22948 tablet_service.cc:1514] Processing DeleteTablet for tablet a7ebcd7a88d54ab2ae9715125661c2af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:24 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:34976
I20260808 17:41:24.604988 22725 tablet_service.cc:1514] Processing DeleteTablet for tablet a7ebcd7a88d54ab2ae9715125661c2af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:24 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:59582
I20260808 17:41:24.605065 23345 tablet_replica.cc:330] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1: stopping tablet replica
I20260808 17:41:24.605072 23346 tablet_replica.cc:330] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af: stopping tablet replica
I20260808 17:41:24.605077 23347 tablet_replica.cc:330] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74: stopping tablet replica
I20260808 17:41:24.605114 23345 raft_consensus.cc:2229] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:24.605126 23346 raft_consensus.cc:2229] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:41:24.605126 23347 raft_consensus.cc:2229] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:24.605152 23345 raft_consensus.cc:2258] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:24.605170 23347 raft_consensus.cc:2258] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:24.605178 23346 raft_consensus.cc:2258] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:24.605433 23346 ts_tablet_manager.cc:1905] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:24.605532 23345 ts_tablet_manager.cc:1905] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:24.605695 23347 ts_tablet_manager.cc:1905] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:24.606987 22481 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 17:41:24.607097 23347 ts_tablet_manager.cc:1918] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:24.607151 23347 log.cc:1196] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/a7ebcd7a88d54ab2ae9715125661c2af
I20260808 17:41:24.607141 23346 ts_tablet_manager.cc:1918] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260808 17:41:24.607146 22481 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:41:24.607156 23345 ts_tablet_manager.cc:1918] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:24.607188 23346 log.cc:1196] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/a7ebcd7a88d54ab2ae9715125661c2af
I20260808 17:41:24.607198 23345 log.cc:1196] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-0/wal/wals/a7ebcd7a88d54ab2ae9715125661c2af
I20260808 17:41:24.607364 23347 ts_tablet_manager.cc:1939] T a7ebcd7a88d54ab2ae9715125661c2af P fc39708682fb412e8d74f11d02349a74: Deleting consensus metadata
I20260808 17:41:24.607396 23345 ts_tablet_manager.cc:1939] T a7ebcd7a88d54ab2ae9715125661c2af P c261af81122f4a72a3f6495ef20fb5d1: Deleting consensus metadata
I20260808 17:41:24.607409 23346 ts_tablet_manager.cc:1939] T a7ebcd7a88d54ab2ae9715125661c2af P b89dbec6a2e7469996db74314623e0af: Deleting consensus metadata
I20260808 17:41:24.607779 22457 catalog_manager.cc:4841] TS c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821): tablet a7ebcd7a88d54ab2ae9715125661c2af (table test-table [id=d377a5e89fe44a5eadf2e8039dd9a27d]) successfully deleted
I20260808 17:41:24.607911 22459 catalog_manager.cc:4841] TS b89dbec6a2e7469996db74314623e0af (127.9.187.194:33529): tablet a7ebcd7a88d54ab2ae9715125661c2af (table test-table [id=d377a5e89fe44a5eadf2e8039dd9a27d]) successfully deleted
I20260808 17:41:24.607970 22459 catalog_manager.cc:4841] TS fc39708682fb412e8d74f11d02349a74 (127.9.187.195:44371): tablet a7ebcd7a88d54ab2ae9715125661c2af (table test-table [id=d377a5e89fe44a5eadf2e8039dd9a27d]) successfully deleted
I20260808 17:41:24.608338 22948 tablet_service.cc:1467] Processing CreateTablet for tablet 8f092b30ec5a4b75ad5504943d06767e (DEFAULT_TABLE table=test-table [id=1a910da5485a4272920c2f30882bc990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.608366 23158 tablet_service.cc:1467] Processing CreateTablet for tablet 8f092b30ec5a4b75ad5504943d06767e (DEFAULT_TABLE table=test-table [id=1a910da5485a4272920c2f30882bc990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.608392 22725 tablet_service.cc:1467] Processing CreateTablet for tablet 8f092b30ec5a4b75ad5504943d06767e (DEFAULT_TABLE table=test-table [id=1a910da5485a4272920c2f30882bc990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:24.608446 22948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f092b30ec5a4b75ad5504943d06767e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.608471 23158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f092b30ec5a4b75ad5504943d06767e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.608479 22725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f092b30ec5a4b75ad5504943d06767e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:24.609236 23303 tablet_bootstrap.cc:492] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af: Bootstrap starting.
I20260808 17:41:24.609525 23303 tablet_bootstrap.cc:654] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.609602 23302 tablet_bootstrap.cc:492] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1: Bootstrap starting.
I20260808 17:41:24.609634 23301 tablet_bootstrap.cc:492] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74: Bootstrap starting.
I20260808 17:41:24.609912 23301 tablet_bootstrap.cc:654] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.610225 23302 tablet_bootstrap.cc:654] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:24.610427 23301 tablet_bootstrap.cc:492] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74: No bootstrap required, opened a new log
I20260808 17:41:24.610481 23301 ts_tablet_manager.cc:1397] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 17:41:24.610589 23301 raft_consensus.cc:348] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.610628 23303 tablet_bootstrap.cc:492] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af: No bootstrap required, opened a new log
I20260808 17:41:24.610659 23301 raft_consensus.cc:374] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.610670 23303 ts_tablet_manager.cc:1397] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 17:41:24.610682 23301 raft_consensus.cc:729] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc39708682fb412e8d74f11d02349a74, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.610723 23301 consensus_queue.cc:260] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.610783 23302 tablet_bootstrap.cc:492] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1: No bootstrap required, opened a new log
I20260808 17:41:24.610765 23303 raft_consensus.cc:348] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.610821 23303 raft_consensus.cc:374] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.610814 23301 ts_tablet_manager.cc:1428] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:24.610833 23302 ts_tablet_manager.cc:1397] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 17:41:24.610844 23303 raft_consensus.cc:729] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b89dbec6a2e7469996db74314623e0af, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.610880 23303 consensus_queue.cc:260] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.610963 23303 ts_tablet_manager.cc:1428] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:24.610966 23302 raft_consensus.cc:348] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.611034 23302 raft_consensus.cc:374] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:24.611057 23302 raft_consensus.cc:729] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c261af81122f4a72a3f6495ef20fb5d1, State: Initialized, Role: FOLLOWER
I20260808 17:41:24.611100 23302 consensus_queue.cc:260] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.611186 23302 ts_tablet_manager.cc:1428] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:24.959983 23404 raft_consensus.cc:482] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:24.960079 23404 raft_consensus.cc:504] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.960218 23404 leader_election.cc:288] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821), fc39708682fb412e8d74f11d02349a74 (127.9.187.195:44371)
I20260808 17:41:24.960417 23189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f092b30ec5a4b75ad5504943d06767e" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc39708682fb412e8d74f11d02349a74" is_pre_election: true
I20260808 17:41:24.960430 22747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f092b30ec5a4b75ad5504943d06767e" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261af81122f4a72a3f6495ef20fb5d1" is_pre_election: true
I20260808 17:41:24.960511 23189 raft_consensus.cc:2454] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 0.
I20260808 17:41:24.960525 22747 raft_consensus.cc:2454] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 0.
I20260808 17:41:24.960671 22883 leader_election.cc:302] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b89dbec6a2e7469996db74314623e0af, fc39708682fb412e8d74f11d02349a74; no voters:
I20260808 17:41:24.960783 23404 raft_consensus.cc:2781] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:41:24.960816 23404 raft_consensus.cc:482] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:24.960837 23404 raft_consensus.cc:3037] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.961504 23404 raft_consensus.cc:504] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.961621 23404 leader_election.cc:288] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 election: Requested vote from peers c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821), fc39708682fb412e8d74f11d02349a74 (127.9.187.195:44371)
I20260808 17:41:24.961786 22747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f092b30ec5a4b75ad5504943d06767e" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261af81122f4a72a3f6495ef20fb5d1"
I20260808 17:41:24.961820 23189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f092b30ec5a4b75ad5504943d06767e" candidate_uuid: "b89dbec6a2e7469996db74314623e0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc39708682fb412e8d74f11d02349a74"
I20260808 17:41:24.961874 23189 raft_consensus.cc:3037] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.961874 22747 raft_consensus.cc:3037] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:24.962525 23189 raft_consensus.cc:2454] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 1.
I20260808 17:41:24.962592 22747 raft_consensus.cc:2454] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b89dbec6a2e7469996db74314623e0af in term 1.
I20260808 17:41:24.962703 22883 leader_election.cc:302] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b89dbec6a2e7469996db74314623e0af, fc39708682fb412e8d74f11d02349a74; no voters:
I20260808 17:41:24.962800 23404 raft_consensus.cc:2781] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:24.962886 23404 raft_consensus.cc:686] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 1 LEADER]: Becoming Leader. State: Replica: b89dbec6a2e7469996db74314623e0af, State: Running, Role: LEADER
I20260808 17:41:24.962944 23404 consensus_queue.cc:237] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } }
I20260808 17:41:24.963523 22481 catalog_manager.cc:5495] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af reported cstate change: term changed from 0 to 1, leader changed from <none> to b89dbec6a2e7469996db74314623e0af (127.9.187.194). New cstate: current_term: 1 leader_uuid: "b89dbec6a2e7469996db74314623e0af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b89dbec6a2e7469996db74314623e0af" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 33529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 } health_report { overall_health: UNKNOWN } } }
I20260808 17:41:25.052971 23422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:25.050846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:47021 (local address 127.9.187.195:44371)
0808 17:41:25.050939 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:25.050941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:25.051012 (+ 71us) server_negotiation.cc:407] Connection header received
0808 17:41:25.051065 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:25.051066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:25.051076 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:25.051132 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:25.051235 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:25.051723 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:25.052409 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:25.052618 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:25.052667 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:25.052796 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:25.052821 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:25.052853 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:25.052892 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 17:41:25.052908 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75,"thread_start_us":44,"threads_started":1}
I20260808 17:41:25.052982 23421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:25.050778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:44371 (local address 127.9.187.194:47021)
0808 17:41:25.050953 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:25.050963 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:25.051017 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:25.051134 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:25.051135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:25.051137 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:41:25.051200 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:25.051201 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:25.051775 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:25.051775 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:25.052344 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:25.052345 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:25.052674 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:25.052674 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:25.052718 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:25.052738 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:41:25.052860 (+ 122us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:41:25.052861 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:41:25.052889 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 17:41:25.052922 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":40,"threads_started":1}
I20260808 17:41:25.054800 22747 raft_consensus.cc:1261] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Refusing update from remote peer b89dbec6a2e7469996db74314623e0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:25.054838 23189 raft_consensus.cc:1261] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Refusing update from remote peer b89dbec6a2e7469996db74314623e0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:25.055025 23404 consensus_queue.cc:1035] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "c261af81122f4a72a3f6495ef20fb5d1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:25.055140 23319 consensus_queue.cc:1035] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc39708682fb412e8d74f11d02349a74" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 44371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:25.061517 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:25.059423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:45287 (local address 127.9.187.194:33529)
0808 17:41:25.059466 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:25.059468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:25.059599 (+ 131us) server_negotiation.cc:407] Connection header received
0808 17:41:25.059645 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:25.059645 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:25.059657 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:25.059698 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:25.059776 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:25.060216 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:25.060855 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:25.061057 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:25.061112 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:25.061250 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:25.061283 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:25.061328 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:25.061433 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 17:41:25.061452 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:41:25.061533 23432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:25.059390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:33529 (local address 127.9.187.195:45287)
0808 17:41:25.059531 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:25.059543 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:25.059600 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:25.059702 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:25.059703 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:25.059704 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:41:25.059741 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:25.059743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:25.060265 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:25.060266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:25.060802 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:25.060804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:25.061116 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:25.061118 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:25.061181 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:25.061185 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:41:25.061342 (+ 157us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:41:25.061345 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:25.061387 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 17:41:25.061441 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260808 17:41:25.067574 22480 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:25.067655 22480 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:25.068207 22480 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c656204d6f95469bbb1dfc95a7bc7ff4: Sending DeleteTablet for 3 replicas of tablet 8f092b30ec5a4b75ad5504943d06767e
I20260808 17:41:25.068421 22948 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f092b30ec5a4b75ad5504943d06767e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:25 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:34976
I20260808 17:41:25.068434 23158 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f092b30ec5a4b75ad5504943d06767e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:25 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:40834
I20260808 17:41:25.068436 22725 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f092b30ec5a4b75ad5504943d06767e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:25 UTC) from {username='oryx', principal='oryx/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:59582
I20260808 17:41:25.068521 23347 tablet_replica.cc:330] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74: stopping tablet replica
I20260808 17:41:25.068533 23345 tablet_replica.cc:330] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1: stopping tablet replica
I20260808 17:41:25.068569 23347 raft_consensus.cc:2229] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:25.068532 23346 tablet_replica.cc:330] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af: stopping tablet replica
I20260808 17:41:25.068588 23345 raft_consensus.cc:2229] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:25.068600 23347 raft_consensus.cc:2258] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:25.068615 23346 raft_consensus.cc:2229] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:41:25.068624 23345 raft_consensus.cc:2258] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:25.068663 23346 raft_consensus.cc:2258] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:25.068895 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 22614
I20260808 17:41:25.068909 23347 ts_tablet_manager.cc:1905] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:25.068919 23345 ts_tablet_manager.cc:1905] T 8f092b30ec5a4b75ad5504943d06767e P c261af81122f4a72a3f6495ef20fb5d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:25.071593 23347 ts_tablet_manager.cc:1918] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:41:25.071635 23346 ts_tablet_manager.cc:1905] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:25.071671 23347 log.cc:1196] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/8f092b30ec5a4b75ad5504943d06767e
I20260808 17:41:25.071910 23347 ts_tablet_manager.cc:1939] T 8f092b30ec5a4b75ad5504943d06767e P fc39708682fb412e8d74f11d02349a74: Deleting consensus metadata
I20260808 17:41:25.072885 23346 ts_tablet_manager.cc:1918] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:41:25.072952 23346 log.cc:1196] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/8f092b30ec5a4b75ad5504943d06767e
I20260808 17:41:25.073171 23346 ts_tablet_manager.cc:1939] T 8f092b30ec5a4b75ad5504943d06767e P b89dbec6a2e7469996db74314623e0af: Deleting consensus metadata
I20260808 17:41:25.073495 22459 catalog_manager.cc:4841] TS b89dbec6a2e7469996db74314623e0af (127.9.187.194:33529): tablet 8f092b30ec5a4b75ad5504943d06767e (table test-table [id=1a910da5485a4272920c2f30882bc990]) successfully deleted
I20260808 17:41:25.075549 22459 catalog_manager.cc:4841] TS fc39708682fb412e8d74f11d02349a74 (127.9.187.195:44371): tablet 8f092b30ec5a4b75ad5504943d06767e (table test-table [id=1a910da5485a4272920c2f30882bc990]) successfully deleted
W20260808 17:41:25.083864 22457 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:39821 (error 108)
I20260808 17:41:25.084082 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 22851
I20260808 17:41:25.086903 23437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:25.084219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:39821 (local address 127.0.0.1:59596)
0808 17:41:25.086813 (+ 2594us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:25.086861 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:39821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2576,"thread_start_us":41,"threads_started":1}
W20260808 17:41:25.086984 22457 catalog_manager.cc:4584] TS c261af81122f4a72a3f6495ef20fb5d1 (127.9.187.193:39821): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f092b30ec5a4b75ad5504943d06767e: Network error: Client connection negotiation failed: client connection to 127.9.187.193:39821: connect: Connection refused (error 111)
I20260808 17:41:25.094450 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 23057
I20260808 17:41:25.105676 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 22428
2026-08-08T17:41:25Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3014 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:25 dist-test-slave-bqcl krb5kdc[23440](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:25 dist-test-slave-bqcl krb5kdc[23440](info): set up 2 sockets
Aug 08 17:41:25 dist-test-slave-bqcl krb5kdc[23440](info): commencing operation
krb5kdc: starting...
W20260808 17:41:26.263971 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:26 dist-test-slave-bqcl krb5kdc[23440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:41:26.378543 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46787
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:46787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:26.459429 23455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:26.459645 23455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:26.459677 23455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:26.460803 23455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:26.460844 23455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:26.460862 23455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:26.460876 23455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:26.460891 23455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:26.462713 23455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:46787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:26.462960 23455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:26.463171 23455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:26.467839 23465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:26.467814 23467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:26.467892 23455 server_base.cc:1034] running on GCE node
W20260808 17:41:26.467828 23471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:26.468329 23455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:26.468618 23455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:26.469780 23455 hybrid_clock.cc:648] HybridClock initialized: now 1786210886469764 us; error 32 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T17:41:26Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1364 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:26 dist-test-slave-bqcl krb5kdc[23477](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:26 dist-test-slave-bqcl krb5kdc[23477](info): set up 2 sockets
Aug 08 17:41:26 dist-test-slave-bqcl krb5kdc[23477](info): commencing operation
krb5kdc: starting...
W20260808 17:41:27.642735 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:27 dist-test-slave-bqcl krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:41:27.754667 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:40753
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:40753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:27.833717 23502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:27.833904 23502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:27.833923 23502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:27.835068 23502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:27.835112 23502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:27.835125 23502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:27.835148 23502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:27.835170 23502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:27.836603 23502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:40753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:40753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:27.836826 23502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:27.837026 23502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:27.841863 23514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:27.841871 23510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:27.841895 23509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:27.842032 23502 server_base.cc:1034] running on GCE node
I20260808 17:41:27.842309 23502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:27.842608 23502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:27.843742 23502 hybrid_clock.cc:648] HybridClock initialized: now 1786210887843732 us; error 28 us; skew 500 ppm
Aug 08 17:41:27 dist-test-slave-bqcl krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210887, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:27.848984 23502 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:41:27.849407 23502 webserver.cc:460] Webserver started at http://127.9.187.254:42527/ using document root <none> and password file <none>
I20260808 17:41:27.849620 23502 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:27.849664 23502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:27.849792 23502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:27.850873 23502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "a5ded3fb641c4def86aa0690159adddc"
format_stamp: "Formatted at 2026-08-08 17:41:27 on dist-test-slave-bqcl"
server_key: "3fa1e98002e02c8705648f676de46c14"
server_key_iv: "a5b1c8a149071471a6350fdc04f97cc7"
server_key_version: "encryptionkey@0"
I20260808 17:41:27.851198 23502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "a5ded3fb641c4def86aa0690159adddc"
format_stamp: "Formatted at 2026-08-08 17:41:27 on dist-test-slave-bqcl"
server_key: "3fa1e98002e02c8705648f676de46c14"
server_key_iv: "a5b1c8a149071471a6350fdc04f97cc7"
server_key_version: "encryptionkey@0"
I20260808 17:41:27.852401 23502 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:27.853073 23528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:27.853221 23502 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:27.853300 23502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "a5ded3fb641c4def86aa0690159adddc"
format_stamp: "Formatted at 2026-08-08 17:41:27 on dist-test-slave-bqcl"
server_key: "3fa1e98002e02c8705648f676de46c14"
server_key_iv: "a5b1c8a149071471a6350fdc04f97cc7"
server_key_version: "encryptionkey@0"
I20260808 17:41:27.853365 23502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:27.866426 23502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:27.868173 23502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:27.868301 23502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:27.872210 23502 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:40753
I20260808 17:41:27.872247 23602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:40753 every 8 connection(s)
I20260808 17:41:27.872570 23502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:27.873399 23604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:27.875682 23604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc: Bootstrap starting.
I20260808 17:41:27.876204 23604 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:27.876456 23604 log.cc:824] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:27.877067 23604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc: No bootstrap required, opened a new log
I20260808 17:41:27.878618 23604 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } }
I20260808 17:41:27.878762 23604 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:27.878811 23604 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5ded3fb641c4def86aa0690159adddc, State: Initialized, Role: FOLLOWER
I20260808 17:41:27.878922 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 23502
I20260808 17:41:27.878962 23604 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } }
I20260808 17:41:27.879029 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:27.879047 23604 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:27.879086 23604 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:27.879135 23604 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:27.879221 9967 external_mini_cluster.cc:1428] Setting key 158bc3aa28ca06ad2f4ea54d47ce463e
I20260808 17:41:27.879742 23604 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } }
I20260808 17:41:27.879897 23604 leader_election.cc:302] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5ded3fb641c4def86aa0690159adddc; no voters:
I20260808 17:41:27.880048 23604 leader_election.cc:288] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:27.880100 23614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:27.880306 23614 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 1 LEADER]: Becoming Leader. State: Replica: a5ded3fb641c4def86aa0690159adddc, State: Running, Role: LEADER
I20260808 17:41:27.880337 23604 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:27.880403 23614 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } }
I20260808 17:41:27.881158 23614 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5ded3fb641c4def86aa0690159adddc. Latest consensus state: current_term: 1 leader_uuid: "a5ded3fb641c4def86aa0690159adddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } } }
I20260808 17:41:27.881304 23614 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:27.881788 23630 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:27.882083 23618 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5ded3fb641c4def86aa0690159adddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } } }
I20260808 17:41:27.882225 23618 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:27.882403 23630 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:27.883905 23630 catalog_manager.cc:1347] Generated new cluster ID: a6f6d964e0e6441097b1ab01700aea81
I20260808 17:41:27.883957 23630 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:41:27 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:27.889277 23613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:27.879678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39824 (local address 127.9.187.254:40753)
0808 17:41:27.879851 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:27.879862 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:27.879896 (+ 34us) server_negotiation.cc:407] Connection header received
0808 17:41:27.880011 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:27.880018 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:27.880089 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:27.880231 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:27.881190 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:27.882601 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:27.883501 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:27.884094 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:27.884199 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:27.886404 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:27.886408 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:27.886408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:27.886420 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:27.887939 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:27.888254 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:27.888257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:27.888258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:27.888351 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:27.888525 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:27.888526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:27.888526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:27.888748 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:27.888901 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:27.888968 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:41:27.889111 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260808 17:41:27.898514 23630 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:27.898984 23630 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:27.904130 23630 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc: Generated new TSK 0
I20260808 17:41:27.904291 23630 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:41:27.941326 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40753
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:28.036727 23644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:28.036919 23644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:28.036939 23644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:28.038007 23644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:28.038048 23644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:28.038071 23644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:28.039487 23644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:28.039662 23644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:28.039822 23644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:28.044639 23650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:28.044693 23652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:28.044829 23644 server_base.cc:1034] running on GCE node
W20260808 17:41:28.044639 23654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:28.045095 23644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:28.045320 23644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:28.046458 23644 hybrid_clock.cc:648] HybridClock initialized: now 1786210888046433 us; error 43 us; skew 500 ppm
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210888, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:28.048961 23644 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:41:28.049355 23644 webserver.cc:460] Webserver started at http://127.9.187.193:42761/ using document root <none> and password file <none>
I20260808 17:41:28.049543 23644 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:28.049587 23644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:28.049724 23644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:28.050729 23644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "cedacde38e1b4341902d7100a7dc5821"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "34c16678954aed7ecd4ddc8f43d438a4"
server_key_iv: "40b56615d5fea8a53b17419fe010507e"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.051059 23644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "cedacde38e1b4341902d7100a7dc5821"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "34c16678954aed7ecd4ddc8f43d438a4"
server_key_iv: "40b56615d5fea8a53b17419fe010507e"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.052268 23644 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:28.052966 23665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.053117 23644 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:28.053196 23644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "cedacde38e1b4341902d7100a7dc5821"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "34c16678954aed7ecd4ddc8f43d438a4"
server_key_iv: "40b56615d5fea8a53b17419fe010507e"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.053260 23644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:28.069509 23644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:28.071458 23644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:28.071581 23644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:28.071807 23644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:28.072098 23644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:28.072132 23644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.072154 23644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:28.072178 23644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.077580 23644 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:35569
I20260808 17:41:28.077641 23827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:35569 every 8 connection(s)
I20260808 17:41:28.077925 23644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210888, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:28.086277 23613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.078626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:39433 (local address 127.9.187.254:40753)
0808 17:41:28.078684 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:28.078685 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:28.078867 (+ 182us) server_negotiation.cc:407] Connection header received
0808 17:41:28.079312 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:28.079312 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:28.079321 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:28.079376 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:28.080307 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.080800 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.081793 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.081987 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.082037 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.083941 (+ 1904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:28.083943 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:28.083943 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:28.083950 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:28.085205 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:28.085553 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:28.085554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:28.085554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:28.085601 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:28.085768 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:28.085768 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:28.085768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:28.085861 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:28.085906 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:28.086098 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 17:41:28.086200 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:41:28.086438 23835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.078579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:39433)
0808 17:41:28.078748 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:28.078789 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:28.079236 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:28.079441 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:28.079444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:28.079996 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:28.080228 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.080236 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.080866 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.080867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.081729 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.081732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.082046 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.082047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.082167 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.082546 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:28.082553 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:28.083861 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:28.085293 (+ 1432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:28.085300 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:28.085302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:28.085499 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:28.085643 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:28.085644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:28.085644 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:28.085729 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:28.085901 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:28.085903 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:28.086003 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 17:41:28.086085 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 17:41:28.086244 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
I20260808 17:41:28.086678 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 23644
I20260808 17:41:28.086798 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:28.086966 23830 heartbeater.cc:347] Connected to a master server at 127.9.187.254:40753
I20260808 17:41:28.087004 9967 external_mini_cluster.cc:1428] Setting key 1eeb4c52bf60c754e767f6a569fe128e
I20260808 17:41:28.087049 23830 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:28.087232 23830 heartbeater.cc:511] Master 127.9.187.254:40753 requested a full tablet report, sending...
I20260808 17:41:28.087766 23552 ts_manager.cc:194] Registered new tserver with Master: cedacde38e1b4341902d7100a7dc5821 (127.9.187.193:35569)
I20260808 17:41:28.088555 23552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:39433
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:41:28.110939 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40753
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:28.191738 23840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:28.191933 23840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:28.191962 23840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:28.193080 23840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:28.193122 23840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:28.193156 23840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:28.194619 23840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23840
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:28.194852 23840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:28.195063 23840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:41:28.199865 23840 server_base.cc:1034] running on GCE node
W20260808 17:41:28.199759 23847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:28.199806 23848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:28.199759 23851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:28.200218 23840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:28.200460 23840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:28.201596 23840 hybrid_clock.cc:648] HybridClock initialized: now 1786210888201583 us; error 27 us; skew 500 ppm
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210888, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:28.204016 23840 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:41:28.204398 23840 webserver.cc:460] Webserver started at http://127.9.187.194:40699/ using document root <none> and password file <none>
I20260808 17:41:28.204599 23840 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:28.204654 23840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:28.204756 23840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:28.205765 23840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "eebb490f8a7c4ba8aad8255e9ec9c0cb"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "a75291919ecb01dac70d512e6def676d"
server_key_iv: "767b11ade6f3b1beb4e3f4c105fd6789"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.206051 23840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "eebb490f8a7c4ba8aad8255e9ec9c0cb"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "a75291919ecb01dac70d512e6def676d"
server_key_iv: "767b11ade6f3b1beb4e3f4c105fd6789"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.207293 23840 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:41:28.207911 23864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.208065 23840 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:28.208148 23840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "eebb490f8a7c4ba8aad8255e9ec9c0cb"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "a75291919ecb01dac70d512e6def676d"
server_key_iv: "767b11ade6f3b1beb4e3f4c105fd6789"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.208201 23840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:28.236328 23840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:28.238029 23840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:28.238185 23840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:28.238386 23840 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:28.238726 23840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:28.238768 23840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.238790 23840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:28.238806 23840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.244138 23840 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:35889
I20260808 17:41:28.244184 24043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:35889 every 8 connection(s)
I20260808 17:41:28.244473 23840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:41:28.245152 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 23840
I20260808 17:41:28.245283 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:28.245482 9967 external_mini_cluster.cc:1428] Setting key 8d78bbbbb4e12bf0ed277b0447c54d47
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210888, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:28.254264 23613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.245515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:49021 (local address 127.9.187.254:40753)
0808 17:41:28.245558 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:28.245560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:28.245664 (+ 104us) server_negotiation.cc:407] Connection header received
0808 17:41:28.246323 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:28.246325 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:28.246336 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:28.246379 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:28.247310 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.247918 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.248899 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.249156 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.249229 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.251420 (+ 2191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:28.251422 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:28.251422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:28.251431 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:28.252851 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:28.253226 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:28.253227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:28.253228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:28.253303 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:28.253573 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:28.253574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:28.253574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:28.253715 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:28.253788 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:28.254038 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 17:41:28.254155 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:41:28.254350 24047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.245207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:49021)
0808 17:41:28.245439 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:28.245572 (+ 133us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:28.246225 (+ 653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:28.246455 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:28.246459 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:28.247017 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:28.247206 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.247210 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.248014 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.248015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.248816 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.248818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.249230 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.249231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.249332 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.249784 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:28.249792 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:28.251321 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:28.252937 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:28.252943 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:28.252945 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:28.253156 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:28.253389 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:28.253390 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:28.253390 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:28.253503 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:28.253784 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:28.253789 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:28.253915 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 17:41:28.253997 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 17:41:28.254165 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":97,"threads_started":1}
I20260808 17:41:28.254841 24044 heartbeater.cc:347] Connected to a master server at 127.9.187.254:40753
I20260808 17:41:28.254940 24044 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
I20260808 17:41:28.255136 24044 heartbeater.cc:511] Master 127.9.187.254:40753 requested a full tablet report, sending...
I20260808 17:41:28.255563 23552 ts_manager.cc:194] Registered new tserver with Master: eebb490f8a7c4ba8aad8255e9ec9c0cb (127.9.187.194:35889)
I20260808 17:41:28.255955 23552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:49021
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:41:28.272454 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40753
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:28.353137 24050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:28.353346 24050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:28.353368 24050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:28.354581 24050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:28.354628 24050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:28.354652 24050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:28.356185 24050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:28.356405 24050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:28.356621 24050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:28.361425 24062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:28.361389 24064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:28.361405 24061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:28.361635 24050 server_base.cc:1034] running on GCE node
I20260808 17:41:28.361878 24050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:28.362099 24050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:28.363277 24050 hybrid_clock.cc:648] HybridClock initialized: now 1786210888363265 us; error 28 us; skew 500 ppm
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210888, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:28.365748 24050 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:41:28.366202 24050 webserver.cc:460] Webserver started at http://127.9.187.195:35097/ using document root <none> and password file <none>
I20260808 17:41:28.366401 24050 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:28.366449 24050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:28.366586 24050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:28.367636 24050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "0e3a29fa86b64c6b8a613aedd4edba9a"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "c634d35ce320a541c378093cdc95bf7d"
server_key_iv: "e157864049f3f05ed7ec6e771b763543"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.367977 24050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "0e3a29fa86b64c6b8a613aedd4edba9a"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "c634d35ce320a541c378093cdc95bf7d"
server_key_iv: "e157864049f3f05ed7ec6e771b763543"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.369287 24050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:41:28.369992 24074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.370186 24050 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:28.370277 24050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "0e3a29fa86b64c6b8a613aedd4edba9a"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "c634d35ce320a541c378093cdc95bf7d"
server_key_iv: "e157864049f3f05ed7ec6e771b763543"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.370350 24050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:28.397908 24050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:28.399915 24050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:28.400035 24050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:28.400267 24050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:28.400570 24050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:28.400606 24050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.400629 24050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:28.400651 24050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.405982 24050 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:44763
I20260808 17:41:28.406067 24252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:44763 every 8 connection(s)
I20260808 17:41:28.406348 24050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:41:28.407721 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 24050
I20260808 17:41:28.407820 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:28.407994 9967 external_mini_cluster.cc:1428] Setting key ec1ef976c90a8f6be9522316f6bf9557
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210888, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:28.414883 23613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.407036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:52779 (local address 127.9.187.254:40753)
0808 17:41:28.407086 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:28.407088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:28.407273 (+ 185us) server_negotiation.cc:407] Connection header received
0808 17:41:28.407848 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:28.407850 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:28.407864 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:28.407924 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:28.409011 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.409508 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.410505 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.410722 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.410773 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.412672 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:28.412674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:28.412674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:28.412680 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:28.413873 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:28.414219 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:28.414220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:28.414220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:28.414268 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:28.414442 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:28.414442 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:28.414442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:28.414530 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:28.414574 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:28.414765 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 17:41:28.414821 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:41:28.415074 24256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.407015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:52779)
0808 17:41:28.407164 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:28.407198 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:28.407731 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:28.407996 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:28.408000 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:28.408705 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:28.408939 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.408944 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.409576 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.409576 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.410444 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.410447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.410783 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.410784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.410888 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.411283 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:28.411290 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:28.412587 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:28.413932 (+ 1345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:28.413935 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:28.413937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:28.414172 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:28.414313 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:28.414313 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:28.414314 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:28.414408 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:28.414569 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:28.414572 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:28.414680 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 17:41:28.414754 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 17:41:28.414863 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
I20260808 17:41:28.415494 24253 heartbeater.cc:347] Connected to a master server at 127.9.187.254:40753
I20260808 17:41:28.415582 24253 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:28.415724 24253 heartbeater.cc:511] Master 127.9.187.254:40753 requested a full tablet report, sending...
I20260808 17:41:28.416101 23552 ts_manager.cc:194] Registered new tserver with Master: 0e3a29fa86b64c6b8a613aedd4edba9a (127.9.187.195:44763)
I20260808 17:41:28.416468 23552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:52779
I20260808 17:41:28.419587 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab.
Entry for principal oryx/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab.
WARNING: no policy specified for oryx/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab.
Entry for principal oryx/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab.
WARNING: no policy specified for oryx/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab.
Entry for principal oryx/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab.
I20260808 17:41:28.488703 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 23644
I20260808 17:41:28.505018 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 23840
I20260808 17:41:28.520876 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 24050
I20260808 17:41:28.551059 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 23502
I20260808 17:41:28.566591 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:40753
--webserver_interface=127.9.187.254
--webserver_port=42527
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:40753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:28.656746 24265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:28.656949 24265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:28.656970 24265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:28.658111 24265 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:28.658223 24265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:28.658246 24265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:28.658258 24265 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:28.658269 24265 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:28.659742 24265 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:40753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:40753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=42527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:28.659974 24265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:28.660185 24265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:28.664812 24273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:28.664884 24265 server_base.cc:1034] running on GCE node
W20260808 17:41:28.664908 24274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:28.664824 24280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:28.665279 24265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:28.665584 24265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:28.666718 24265 hybrid_clock.cc:648] HybridClock initialized: now 1786210888666703 us; error 36 us; skew 500 ppm
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210888, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:28.669152 24265 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:41:28.669576 24265 webserver.cc:460] Webserver started at http://127.9.187.254:42527/ using document root <none> and password file <none>
I20260808 17:41:28.669762 24265 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:28.669816 24265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:28.671154 24265 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:41:28.671744 24287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.671928 24265 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:28.672008 24265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "a5ded3fb641c4def86aa0690159adddc"
format_stamp: "Formatted at 2026-08-08 17:41:27 on dist-test-slave-bqcl"
server_key: "3fa1e98002e02c8705648f676de46c14"
server_key_iv: "a5b1c8a149071471a6350fdc04f97cc7"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.672327 24265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:28.691116 24265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:28.693253 24265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:28.693372 24265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:28.697523 24265 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:40753
I20260808 17:41:28.697744 24366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:40753 every 8 connection(s)
I20260808 17:41:28.698014 24265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:28.701038 24367 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:41:28.701825 24367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc: Bootstrap starting.
I20260808 17:41:28.702409 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 24265
I20260808 17:41:28.702673 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:35569
--local_ip_for_outbound_sockets=127.9.187.193
--tserver_master_addrs=127.9.187.254:40753
--webserver_port=42761
--webserver_interface=127.9.187.193
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.187.193
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:41:28.712328 24367 log.cc:824] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:28.713914 24367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:41:28.714197 24367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc: Bootstrap complete.
I20260808 17:41:28.716246 24367 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } }
I20260808 17:41:28.716473 24367 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5ded3fb641c4def86aa0690159adddc, State: Initialized, Role: FOLLOWER
I20260808 17:41:28.716641 24367 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } }
I20260808 17:41:28.716717 24367 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:28.716771 24367 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:28.716820 24367 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:41:28.717779 24367 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } }
I20260808 17:41:28.717886 24367 leader_election.cc:302] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5ded3fb641c4def86aa0690159adddc; no voters:
I20260808 17:41:28.718058 24367 leader_election.cc:288] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 17:41:28.718109 24373 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 2 FOLLOWER]: Leader election won for term 2
I20260808 17:41:28.718257 24373 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [term 2 LEADER]: Becoming Leader. State: Replica: a5ded3fb641c4def86aa0690159adddc, State: Running, Role: LEADER
I20260808 17:41:28.718356 24367 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:28.718348 24373 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } }
I20260808 17:41:28.718637 24374 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a5ded3fb641c4def86aa0690159adddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } } }
I20260808 17:41:28.718729 24374 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:28.718986 24375 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5ded3fb641c4def86aa0690159adddc. Latest consensus state: current_term: 2 leader_uuid: "a5ded3fb641c4def86aa0690159adddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ded3fb641c4def86aa0690159adddc" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40753 } } }
I20260808 17:41:28.719089 24375 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:28.719242 24380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:28.719713 24380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:28.719837 24380 catalog_manager.cc:1259] Loaded cluster ID: a6f6d964e0e6441097b1ab01700aea81
I20260808 17:41:28.719871 24380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:28.721199 24380 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:28.721369 24380 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a5ded3fb641c4def86aa0690159adddc: Loaded TSK: 0
I20260808 17:41:28.721570 24380 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:41:28.785131 24369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:28.785372 24369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:28.785403 24369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:28.786589 24369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:28.786633 24369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:28.786675 24369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:28.788131 24369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.193.keytab
--principal=oryx/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:35569
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=42761
--tserver_master_addrs=127.9.187.254:40753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:28.788358 24369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:28.788563 24369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:28.794237 24410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:28.794247 24409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:28.794512 24413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:28.794556 24369 server_base.cc:1034] running on GCE node
I20260808 17:41:28.794771 24369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:28.795027 24369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:28.796209 24369 hybrid_clock.cc:648] HybridClock initialized: now 1786210888796189 us; error 33 us; skew 500 ppm
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210888, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:28.799182 24369 init.cc:377] Logged in from keytab as oryx/127.9.187.193@KRBTEST.COM (short username oryx)
I20260808 17:41:28.799715 24369 webserver.cc:460] Webserver started at http://127.9.187.193:42761/ using document root <none> and password file <none>
I20260808 17:41:28.799960 24369 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:28.800050 24369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:28.801728 24369 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:28.802392 24426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.802563 24369 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:41:28.802659 24369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "cedacde38e1b4341902d7100a7dc5821"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "34c16678954aed7ecd4ddc8f43d438a4"
server_key_iv: "40b56615d5fea8a53b17419fe010507e"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.803054 24369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:28.822036 24369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:28.824293 24369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:28.824445 24369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:28.824698 24369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:28.825030 24369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:28.825078 24369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.825116 24369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:28.825141 24369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.832247 24369 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:35569
I20260808 17:41:28.832276 24606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:35569 every 8 connection(s)
I20260808 17:41:28.832700 24369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:41:28.838231 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 24369
I20260808 17:41:28.838538 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:35889
--local_ip_for_outbound_sockets=127.9.187.194
--tserver_master_addrs=127.9.187.254:40753
--webserver_port=40699
--webserver_interface=127.9.187.194
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.187.194
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:28.840617 24609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.833352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:42309)
0808 17:41:28.833506 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:28.833546 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:28.834062 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:28.834584 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:28.834588 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:28.835123 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:28.835312 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.835317 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.836409 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.836410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.837167 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.837177 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.837739 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.837740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.837855 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.838345 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:28.838354 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:28.840426 (+ 2072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
W20260808 17:41:28.840996 24607 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:40753 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.187.254:40753: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
W20260808 17:41:28.841351 24610 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:28.833429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:42309 (local address 127.9.187.254:40753)
0808 17:41:28.834243 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:28.834251 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:28.834278 (+ 27us) server_negotiation.cc:407] Connection header received
0808 17:41:28.834376 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:28.834381 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:28.834419 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:28.834534 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:28.835431 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.836311 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.837254 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.837652 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.837754 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.840582 (+ 2828us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:42309: BlockingRecv error: recv got EOF from 127.9.187.193:42309 (error 108)
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":95,"threads_started":1}
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:28.845175 24609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.841205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:42101)
0808 17:41:28.841475 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:28.841486 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:28.841525 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:28.841686 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:28.841686 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:28.841803 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:28.841842 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.841844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.842467 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.842469 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.842948 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.842950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.843251 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.843252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.843314 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.843663 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:28.843668 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:28.845118 (+ 1450us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255}
W20260808 17:41:28.845285 24612 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:28.841250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:42101 (local address 127.9.187.254:40753)
0808 17:41:28.841568 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:28.841570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:28.841578 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:28.841597 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:28.841597 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:28.841607 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:28.841680 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:28.841906 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.842396 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.843013 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.843195 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.843246 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.845213 (+ 1967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:42101: BlockingRecv error: recv got EOF from 127.9.187.193:42101 (error 108)
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":102,"threads_started":1}
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:28.849247 24609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.845624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:38241)
0808 17:41:28.845702 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:28.845711 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:28.845752 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:28.845857 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:28.845858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:28.845973 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:28.845997 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.845998 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.846615 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.846616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.847087 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.847088 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.847393 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.847394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.847442 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.847785 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:28.847790 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:28.849193 (+ 1403us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 17:41:28.849316 24612 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:28.845668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:38241 (local address 127.9.187.254:40753)
0808 17:41:28.845702 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:28.845704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:28.845740 (+ 36us) server_negotiation.cc:407] Connection header received
0808 17:41:28.845803 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:28.845803 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:28.845812 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:28.845856 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:28.846056 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.846543 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.847151 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.847339 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.847390 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.849270 (+ 1880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:38241: BlockingRecv error: recv got EOF from 127.9.187.193:38241 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260808 17:41:28.849547 24607 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:41:28.923933 24611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:28.924137 24611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:28.924160 24611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:28.925271 24611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:28.925305 24611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:28.925328 24611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:28.926700 24611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.194.keytab
--principal=oryx/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:35889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=40699
--tserver_master_addrs=127.9.187.254:40753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:28.926894 24611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:28.927073 24611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:28.931679 24617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:28.931669 24621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:28.931664 24618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:28.932047 24611 server_base.cc:1034] running on GCE node
I20260808 17:41:28.932227 24611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:28.932410 24611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:28.933560 24611 hybrid_clock.cc:648] HybridClock initialized: now 1786210888933542 us; error 33 us; skew 500 ppm
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210888, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:28.936074 24611 init.cc:377] Logged in from keytab as oryx/127.9.187.194@KRBTEST.COM (short username oryx)
I20260808 17:41:28.936534 24611 webserver.cc:460] Webserver started at http://127.9.187.194:40699/ using document root <none> and password file <none>
I20260808 17:41:28.936745 24611 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:28.936815 24611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:28.938207 24611 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:41:28.938787 24631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.938941 24611 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:28.939028 24611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "eebb490f8a7c4ba8aad8255e9ec9c0cb"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "a75291919ecb01dac70d512e6def676d"
server_key_iv: "767b11ade6f3b1beb4e3f4c105fd6789"
server_key_version: "encryptionkey@0"
I20260808 17:41:28.939349 24611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:28.950527 24611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:28.954957 24611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:28.955114 24611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:28.955343 24611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:28.955657 24611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:28.955701 24611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.955727 24611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:28.955760 24611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:28.961352 24611 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:35889
I20260808 17:41:28.961406 24809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:35889 every 8 connection(s)
I20260808 17:41:28.961719 24611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:41:28.965013 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 24611
I20260808 17:41:28.965284 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:44763
--local_ip_for_outbound_sockets=127.9.187.195
--tserver_master_addrs=127.9.187.254:40753
--webserver_port=35097
--webserver_interface=127.9.187.195
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.187.195
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 17:41:28.969022 24612 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:28.962473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:59379 (local address 127.9.187.254:40753)
0808 17:41:28.962520 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:28.962522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:28.962736 (+ 214us) server_negotiation.cc:407] Connection header received
0808 17:41:28.963191 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:28.963192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:28.963205 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:28.963262 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:28.964148 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.964640 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.965706 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.965907 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.965965 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.968973 (+ 3008us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:59379: BlockingRecv error: recv got EOF from 127.9.187.194:59379 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:41:28.969084 24815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.962453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:59379)
0808 17:41:28.962612 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:28.962654 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:28.963116 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:28.963320 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:28.963324 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:28.963873 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:28.964064 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.964069 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.964714 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.964715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.965621 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.965623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.965979 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.965979 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.966102 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.966594 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:28.966602 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:28.968892 (+ 2290us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
W20260808 17:41:28.969329 24812 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:40753 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.187.254:40753: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:28.973443 24815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.969548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:33017)
0808 17:41:28.969671 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:28.969683 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:28.969741 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:28.969869 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:28.969870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:28.969995 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:28.970036 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.970038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.970643 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.970644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.971137 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.971138 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.971459 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.971460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.971522 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.971872 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:28.971877 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:28.973379 (+ 1502us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105}
W20260808 17:41:28.973528 24612 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:28.969622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:33017 (local address 127.9.187.254:40753)
0808 17:41:28.969660 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:28.969662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:28.969720 (+ 58us) server_negotiation.cc:407] Connection header received
0808 17:41:28.969797 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:28.969798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:28.969808 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:28.969855 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:28.970101 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.970576 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.971222 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.971404 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.971456 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.973473 (+ 2017us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:33017: BlockingRecv error: recv got EOF from 127.9.187.194:33017 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:28 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:28.977958 24815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:28.973754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:56073)
0808 17:41:28.973801 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:28.973812 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:28.973857 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:28.973973 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:28.973973 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:28.974107 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:28.974174 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.974176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.974845 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.974846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.975577 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:28.975580 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.975932 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.975934 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:28.975990 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.976314 (+ 324us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:28.976319 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:28.977895 (+ 1576us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 17:41:28.978060 24612 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:28.973803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:56073 (local address 127.9.187.254:40753)
0808 17:41:28.973832 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:28.973834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:28.973844 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:28.973909 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:28.973910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:28.973918 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:28.973972 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:28.974247 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.974756 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.975670 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:28.975863 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:28.975920 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:28.978004 (+ 2084us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:56073: BlockingRecv error: recv got EOF from 127.9.187.194:56073 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260808 17:41:28.978230 24812 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:41:29.049247 24817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:29.049437 24817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:29.049458 24817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:29.050597 24817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:29.050637 24817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:29.050661 24817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:29.052055 24817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/krb5kdc/oryx_127.9.187.195.keytab
--principal=oryx/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:44763
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=35097
--tserver_master_addrs=127.9.187.254:40753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:29.052253 24817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:29.052425 24817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:29.057066 24823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:29.057204 24817 server_base.cc:1034] running on GCE node
W20260808 17:41:29.057073 24827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:29.057092 24824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:29.057576 24817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:29.057811 24817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:29.058982 24817 hybrid_clock.cc:648] HybridClock initialized: now 1786210889058965 us; error 32 us; skew 500 ppm
Aug 08 17:41:29 dist-test-slave-bqcl krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210889, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:29.061475 24817 init.cc:377] Logged in from keytab as oryx/127.9.187.195@KRBTEST.COM (short username oryx)
I20260808 17:41:29.061878 24817 webserver.cc:460] Webserver started at http://127.9.187.195:35097/ using document root <none> and password file <none>
I20260808 17:41:29.062093 24817 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:29.062179 24817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:29.063457 24817 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:41:29.064000 24840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:29.064152 24817 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:29.064235 24817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "0e3a29fa86b64c6b8a613aedd4edba9a"
format_stamp: "Formatted at 2026-08-08 17:41:28 on dist-test-slave-bqcl"
server_key: "c634d35ce320a541c378093cdc95bf7d"
server_key_iv: "e157864049f3f05ed7ec6e771b763543"
server_key_version: "encryptionkey@0"
I20260808 17:41:29.064577 24817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:29.082597 24817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:29.084694 24817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:29.084830 24817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:29.085042 24817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:29.085345 24817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:29.085379 24817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:29.085407 24817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:29.085424 24817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:29.090849 24817 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:44763
I20260808 17:41:29.090888 25012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:44763 every 8 connection(s)
I20260808 17:41:29.091208 24817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:41:29.091488 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 24817
Aug 08 17:41:29 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:29 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 17:41:29.098393 24610 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:29.092023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:59979 (local address 127.9.187.254:40753)
0808 17:41:29.092056 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:29.092058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:29.092205 (+ 147us) server_negotiation.cc:407] Connection header received
0808 17:41:29.092721 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:29.092722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:29.092739 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:29.092791 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:29.093715 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.094237 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.095185 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.095372 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.095425 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:29.098331 (+ 2906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:59979: BlockingRecv error: recv got EOF from 127.9.187.195:59979 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:41:29.098538 25018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:29.091895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:59979)
0808 17:41:29.092082 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:29.092128 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:29.092625 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:29.092862 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:29.092866 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:29.093417 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:29.093614 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:29.093619 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.094313 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.094314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:29.095100 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:29.095103 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.095441 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.095441 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:29.095556 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:29.095975 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:29.095983 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:29.098258 (+ 2275us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":86,"threads_started":1}
W20260808 17:41:29.098759 25015 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:40753 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.187.254:40753: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
I20260808 17:41:29.098790 24612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:29.091900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39832 (local address 127.9.187.254:40753)
0808 17:41:29.091950 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:29.091953 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:29.092099 (+ 146us) server_negotiation.cc:407] Connection header received
0808 17:41:29.092202 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:29.092203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:29.092215 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:29.092274 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:29.092840 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.093332 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.094163 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.094351 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.094406 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:29.095592 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:29.095596 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:29.095596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:29.095607 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:29.097219 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:29.097586 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:29.097590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:29.097590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:29.097724 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:29.097898 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:29.097899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:29.097899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:29.098225 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:29.098375 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:29.098607 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 17:41:29.098731 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 17:41:29 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:29 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:29.102658 25018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:29.099073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:49381)
0808 17:41:29.099205 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:29.099216 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:29.099260 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:29.099395 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:29.099396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:29.099527 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:29.099577 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:29.099578 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.100134 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.100134 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:29.100616 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:29.100617 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.100893 (+ 276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.100894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:29.100937 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:29.101230 (+ 293us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:29.101240 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:29.102614 (+ 1374us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114}
W20260808 17:41:29.102746 24612 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:29.099098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:49381 (local address 127.9.187.254:40753)
0808 17:41:29.099134 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:29.099136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:29.099257 (+ 121us) server_negotiation.cc:407] Connection header received
0808 17:41:29.099315 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:29.099315 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:29.099324 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:29.099379 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:29.099643 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.100078 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.100669 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.100844 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.100887 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:29.102696 (+ 1809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:49381: BlockingRecv error: recv got EOF from 127.9.187.195:49381 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
Aug 08 17:41:29 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:29 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:29.106173 25018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:29.102885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:42127)
0808 17:41:29.102917 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:29.102928 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:29.102970 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:29.103065 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:29.103066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:29.103162 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:29.103186 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:29.103187 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.103694 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.103695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:29.104149 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:29.104150 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.104398 (+ 248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.104399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:29.104430 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:29.104710 (+ 280us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:29.104713 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:29.106087 (+ 1374us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 17:41:29.106249 24612 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:29.102936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:42127 (local address 127.9.187.254:40753)
0808 17:41:29.102968 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:29.102969 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:29.102976 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:41:29.103008 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:29.103009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:29.103016 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:29.103058 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:29.103229 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.103647 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.104198 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.104356 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.104395 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:29.106206 (+ 1811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:42127: BlockingRecv error: recv got EOF from 127.9.187.195:42127 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 17:41:29.106319 25015 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 17:41:29 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:29 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:29.854749 25019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:29.849927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:59263)
0808 17:41:29.850059 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:29.850069 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:29.850140 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:29.850273 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:29.850273 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:29.850449 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:29.850503 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:29.850504 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.851156 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.851158 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:29.851732 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:29.851734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.852068 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.852070 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:29.852128 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:29.852645 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:29.852650 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:29.854653 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":67,"threads_started":1}
W20260808 17:41:29.854831 25021 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:29.849975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:59263 (local address 127.9.187.254:40753)
0808 17:41:29.850098 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:29.850099 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:29.850108 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:29.850192 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:29.850192 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:29.850203 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:29.850260 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:29.850560 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.851070 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.851798 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.851979 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.852022 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:29.854770 (+ 2748us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:59263: BlockingRecv error: recv got EOF from 127.9.187.193:59263 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":60,"threads_started":1}
Aug 08 17:41:29 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:29 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:29.983210 25023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:29.978602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:41651)
0808 17:41:29.978731 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:29.978742 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:29.978802 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:29.978918 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:29.978919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:29.979084 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:29.979132 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:29.979134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.979770 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.979771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:29.980350 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:29.980352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.980677 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.980678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:29.980750 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:29.981243 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:29.981248 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:29.983142 (+ 1894us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
W20260808 17:41:29.983304 25021 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:29.978672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:41651 (local address 127.9.187.254:40753)
0808 17:41:29.978731 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:29.978733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:29.978798 (+ 65us) server_negotiation.cc:407] Connection header received
0808 17:41:29.978857 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:29.978857 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:29.978868 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:29.978907 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:29.979182 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.979680 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.980425 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:29.980604 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:29.980649 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:29.983243 (+ 2594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:41651: BlockingRecv error: recv got EOF from 127.9.187.194:41651 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 17:41:30 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:30 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:30.111179 25024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:30.106650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:59709)
0808 17:41:30.106778 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:30.106792 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:30.106868 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:30.107007 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:30.107008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:30.107186 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:30.107231 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:30.107233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.107951 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.107952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:30.108501 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:30.108502 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.108840 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.108841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:30.108896 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:30.109345 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:30.109349 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:30.111105 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":70,"threads_started":1}
W20260808 17:41:30.111249 25021 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:30.106719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:59709 (local address 127.9.187.254:40753)
0808 17:41:30.106792 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:30.106794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:30.106862 (+ 68us) server_negotiation.cc:407] Connection header received
0808 17:41:30.106935 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:30.106936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:30.106949 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:30.107002 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:30.107306 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.107875 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.108580 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.108784 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.108836 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:30.111191 (+ 2355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:59709: BlockingRecv error: recv got EOF from 127.9.187.195:59709 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 17:41:30 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:30 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:30.861948 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:30.855349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:42967)
0808 17:41:30.855549 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:30.855570 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:30.855664 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:30.855863 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:30.855864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:30.856124 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:30.856199 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:30.856201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.857236 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.857239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:30.858178 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:30.858181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.858680 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.858681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:30.858748 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:30.859351 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:30.859356 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:30.861869 (+ 2513us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":115,"threads_started":1}
W20260808 17:41:30.862172 25029 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:30.855407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:42967 (local address 127.9.187.254:40753)
0808 17:41:30.855632 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:30.855634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:30.855644 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:30.855732 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:30.855739 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:30.855752 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:30.855845 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:30.856294 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.857117 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.858269 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.858585 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.858680 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:30.862007 (+ 3327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:42967: BlockingRecv error: recv got EOF from 127.9.187.193:42967 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":105,"threads_started":1}
Aug 08 17:41:30 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:30 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:30.990373 25030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:30.983760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:40377)
0808 17:41:30.983940 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:30.983957 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:30.984048 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:30.984246 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:30.984247 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:30.984507 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:30.984595 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:30.984597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.985521 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.985522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:30.986319 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:30.986322 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.986754 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.986756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:30.986830 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:30.987465 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:30.987472 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:30.990248 (+ 2776us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":82,"threads_started":1}
W20260808 17:41:30.990473 25029 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:30.983855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:40377 (local address 127.9.187.254:40753)
0808 17:41:30.983959 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:30.983961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:30.984024 (+ 63us) server_negotiation.cc:407] Connection header received
0808 17:41:30.984144 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:30.984145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:30.984163 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:30.984228 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:30.984689 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.985427 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.986408 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:30.986674 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:30.986757 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:30.990382 (+ 3625us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:40377: BlockingRecv error: recv got EOF from 127.9.187.194:40377 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 17:41:31 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:31 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:31.118566 25035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:31.111721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:45941)
0808 17:41:31.111915 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:31.111935 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:31.112034 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:31.112251 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:31.112251 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:31.112558 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:31.112634 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:31.112637 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.113579 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.113580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:31.114432 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:31.114435 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.114928 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.114929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:31.115026 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:31.115656 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:31.115660 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:31.118477 (+ 2817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":102,"threads_started":1}
W20260808 17:41:31.118729 25029 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:31.111861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:45941 (local address 127.9.187.254:40753)
0808 17:41:31.111932 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:31.111935 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:31.112008 (+ 73us) server_negotiation.cc:407] Connection header received
0808 17:41:31.112144 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:31.112145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:31.112170 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:31.112235 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:31.112735 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.113462 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.114547 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.114840 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.114928 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:31.118618 (+ 3690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:45941: BlockingRecv error: recv got EOF from 127.9.187.195:45941 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 17:41:31 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:31 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:31.866966 25039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:31.862454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:55897)
0808 17:41:31.862586 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:31.862598 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:31.862659 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:31.862786 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:31.862787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:31.862950 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:31.863000 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:31.863002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.863828 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.863829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:31.864389 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:31.864391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.864706 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.864706 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:31.864744 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:31.865145 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:31.865148 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:31.866904 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
W20260808 17:41:31.867134 25040 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:31.862511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:55897 (local address 127.9.187.254:40753)
0808 17:41:31.862648 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:31.862650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:31.862659 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:31.862708 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:31.862708 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:31.862719 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:31.862776 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:31.863088 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.863762 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.864451 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.864656 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.864704 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:31.867010 (+ 2306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:55897: BlockingRecv error: recv got EOF from 127.9.187.193:55897 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
Aug 08 17:41:31 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:31 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:31.995303 25041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:31.990890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:42173)
0808 17:41:31.991059 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:31.991070 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:31.991126 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:31.991248 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:31.991249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:31.991415 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:31.991464 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:31.991466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.992057 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.992058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:31.992590 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:31.992592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.992877 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.992878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:31.992913 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:31.993353 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:31.993358 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:31.995241 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":85,"threads_started":1}
W20260808 17:41:31.995419 25040 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:31.990965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:42173 (local address 127.9.187.254:40753)
0808 17:41:31.991021 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:31.991023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:31.991121 (+ 98us) server_negotiation.cc:407] Connection header received
0808 17:41:31.991181 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:31.991182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:31.991193 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:31.991241 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:31.991513 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.992005 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.992647 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:31.992829 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:31.992875 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:31.995352 (+ 2477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:42173: BlockingRecv error: recv got EOF from 127.9.187.194:42173 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 17:41:32 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:32 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:32.123386 25043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:32.119139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:41711)
0808 17:41:32.119293 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:32.119303 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:32.119362 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:32.119470 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:32.119471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:32.119632 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:32.119680 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:32.119682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.120289 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.120290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:32.120822 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:32.120824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.121148 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.121149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:32.121185 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:32.121596 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:32.121601 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:32.123326 (+ 1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":93,"threads_started":1}
W20260808 17:41:32.123476 25040 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:32.119178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:41711 (local address 127.9.187.254:40753)
0808 17:41:32.119232 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:32.119234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:32.119353 (+ 119us) server_negotiation.cc:407] Connection header received
0808 17:41:32.119402 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:32.119402 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:32.119415 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:32.119456 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:32.119724 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.120234 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.120898 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.121095 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.121146 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:32.123415 (+ 2269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:41711: BlockingRecv error: recv got EOF from 127.9.187.195:41711 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 08 17:41:32 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:32 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:32.875249 25046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:32.867384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:50301)
0808 17:41:32.867507 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:32.867516 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:32.867562 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:32.867699 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:32.867700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:32.867865 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:32.867915 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:32.867917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.868627 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.868628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:32.869169 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:32.869171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.869512 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.869513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:32.869549 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:32.873237 (+ 3688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:32.873242 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:32.875189 (+ 1947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
W20260808 17:41:32.875375 25048 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:32.867445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:50301 (local address 127.9.187.254:40753)
0808 17:41:32.867589 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:32.867591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:32.867598 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:41:32.867619 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:32.867619 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:32.867629 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:32.867689 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:32.867981 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.868552 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.869250 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.869456 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.869536 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:32.875297 (+ 5761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:50301: BlockingRecv error: recv got EOF from 127.9.187.193:50301 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":89,"threads_started":1}
Aug 08 17:41:32 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:32 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:33.000198 25050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:32.995752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:39907)
0808 17:41:32.995878 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:32.995889 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:32.995947 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:32.996107 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:32.996107 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:32.996283 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:32.996335 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:32.996337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.996945 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.996945 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:32.997482 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:32.997484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.997782 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.997783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:32.997856 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:32.998410 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:32.998416 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:33.000137 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
W20260808 17:41:33.000303 25048 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:32.995833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:39907 (local address 127.9.187.254:40753)
0808 17:41:32.995888 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:32.995890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:32.995932 (+ 42us) server_negotiation.cc:407] Connection header received
0808 17:41:32.995988 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:32.995989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:32.995999 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:32.996092 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:32.996393 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.996890 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.997545 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:32.997732 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:32.997779 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:33.000233 (+ 2454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:39907: BlockingRecv error: recv got EOF from 127.9.187.194:39907 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 17:41:33 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:33 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:33.128430 25051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:33.123869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:33705)
0808 17:41:33.123989 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:33.124000 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:33.124061 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:33.124191 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:33.124191 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:33.124352 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:33.124402 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:33.124404 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:33.125055 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:33.125056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:33.125621 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:33.125623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:33.125955 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:33.125955 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:33.126002 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:33.126522 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:33.126527 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:33.128370 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":68,"threads_started":1}
W20260808 17:41:33.128515 25048 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:33.123982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:33705 (local address 127.9.187.254:40753)
0808 17:41:33.124037 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:33.124039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:33.124049 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:33.124113 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:33.124114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:33.124126 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:33.124178 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:33.124451 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:33.124963 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:33.125708 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:33.125898 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:33.125949 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:33.128450 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:33705: BlockingRecv error: recv got EOF from 127.9.187.195:33705 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 08 17:41:33 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:33 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:33.879906 25052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:33.875699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:50793)
0808 17:41:33.875831 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:33.875841 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:33.875904 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:33.876020 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:33.876021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:33.876204 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:33.876262 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:33.876264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:33.876869 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:33.876870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:33.877397 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:33.877398 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:33.877715 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:33.877716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:33.877770 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:33.878247 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:33.878251 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:33.879846 (+ 1595us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":76,"threads_started":1}
W20260808 17:41:33.880007 25055 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:33.875756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:50793 (local address 127.9.187.254:40753)
0808 17:41:33.875857 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:33.875859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:33.875886 (+ 27us) server_negotiation.cc:407] Connection header received
0808 17:41:33.875944 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:33.875944 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:33.875953 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:33.876009 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:33.876313 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:33.876818 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:33.877447 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:33.877636 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:33.877679 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:33.879939 (+ 2260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:50793: BlockingRecv error: recv got EOF from 127.9.187.193:50793 (error 108)
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":52,"threads_started":1}
Aug 08 17:41:34 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:34 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:34.005167 25056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:34.000666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:38331)
0808 17:41:34.000793 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:34.000807 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:34.000872 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:34.000994 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:34.000994 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:34.001173 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:34.001221 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:34.001223 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.001882 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.001884 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:34.002548 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:34.002552 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.002905 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.002906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:34.002959 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:34.003402 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:34.003407 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:34.005089 (+ 1682us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
W20260808 17:41:34.005260 25055 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:34.000762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:38331 (local address 127.9.187.254:40753)
0808 17:41:34.000826 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:34.000828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:34.000854 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:41:34.000927 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:34.000928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:34.000940 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:34.000988 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:34.001287 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.001808 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.002640 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.002847 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.002901 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:34.005193 (+ 2292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:38331: BlockingRecv error: recv got EOF from 127.9.187.194:38331 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 17:41:34 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:34 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:34.133209 25057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:34.128842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:52635)
0808 17:41:34.128987 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:34.128998 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:34.129060 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:34.129178 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:34.129179 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:34.129342 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:34.129390 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:34.129392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.130002 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.130003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:34.130558 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:34.130560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.130876 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.130877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:34.130922 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:34.131368 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:34.131373 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:34.133131 (+ 1758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
W20260808 17:41:34.133360 25055 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:34.128907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:52635 (local address 127.9.187.254:40753)
0808 17:41:34.128961 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:34.128963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:34.129047 (+ 84us) server_negotiation.cc:407] Connection header received
0808 17:41:34.129114 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:34.129114 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:34.129127 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:34.129165 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:34.129442 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.129946 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.130617 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.130807 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.130854 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:34.133302 (+ 2448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:52635: BlockingRecv error: recv got EOF from 127.9.187.195:52635 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 17:41:34 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:34 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:34.884743 25058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:34.880345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:34215)
0808 17:41:34.880477 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:34.880488 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:34.880542 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:34.880663 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:34.880663 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:34.880827 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:34.880877 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:34.880878 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.881483 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.881483 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:34.882000 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:34.882001 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.882357 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.882358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:34.882407 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:34.882871 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:34.882876 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:34.884685 (+ 1809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
W20260808 17:41:34.884865 25060 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:34.880425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:34215 (local address 127.9.187.254:40753)
0808 17:41:34.880535 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:34.880536 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:34.880545 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:34.880585 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:34.880586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:34.880597 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:34.880652 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:34.880930 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.881429 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.882053 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:34.882288 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:34.882341 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:34.884785 (+ 2444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:34215: BlockingRecv error: recv got EOF from 127.9.187.193:34215 (error 108)
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":50,"threads_started":1}
Aug 08 17:41:35 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:35 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:35.010257 25061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:35.005725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:38745)
0808 17:41:35.005881 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:35.005892 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:35.005954 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:35.006074 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:35.006075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:35.006285 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:35.006337 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:35.006339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.006949 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.006950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:35.007566 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:35.007569 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.007888 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.007889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:35.007930 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:35.008426 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:35.008430 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:35.010171 (+ 1741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
W20260808 17:41:35.010335 25060 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:35.005809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:38745 (local address 127.9.187.254:40753)
0808 17:41:35.005864 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:35.005867 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:35.005947 (+ 80us) server_negotiation.cc:407] Connection header received
0808 17:41:35.005996 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:35.005997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:35.006009 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:35.006056 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:35.006389 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.006882 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.007642 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.007836 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.007883 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:35.010281 (+ 2398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:38745: BlockingRecv error: recv got EOF from 127.9.187.194:38745 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 08 17:41:35 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:35 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:35.138015 25062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:35.133685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:41815)
0808 17:41:35.133805 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:35.133816 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:35.133874 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:35.133975 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:35.133975 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:35.134184 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:35.134233 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:35.134236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.134855 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.134856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:35.135383 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:35.135385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.135698 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.135699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:35.135757 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:35.136238 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:35.136242 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:35.137956 (+ 1714us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":59,"threads_started":1}
W20260808 17:41:35.138080 25060 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:35.133763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:41815 (local address 127.9.187.254:40753)
0808 17:41:35.133808 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:35.133810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:35.133859 (+ 49us) server_negotiation.cc:407] Connection header received
0808 17:41:35.133920 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:35.133921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:35.133934 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:35.133968 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:35.134286 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.134795 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.135447 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.135617 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.135659 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:35.138027 (+ 2368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:41815: BlockingRecv error: recv got EOF from 127.9.187.195:41815 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 08 17:41:35 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:35 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:35.889505 25063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:35.885157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:45131)
0808 17:41:35.885290 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:35.885300 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:35.885350 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:35.885467 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:35.885467 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:35.885629 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:35.885679 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:35.885681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.886312 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.886313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:35.886871 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:35.886872 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.887204 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.887205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:35.887262 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:35.887705 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:35.887709 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:35.889427 (+ 1718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":61,"threads_started":1}
W20260808 17:41:35.889591 25064 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:35.885218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:45131 (local address 127.9.187.254:40753)
0808 17:41:35.885345 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:35.885347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:35.885357 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:35.885398 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:35.885399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:35.885410 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:35.885457 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:35.885741 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.886260 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.886931 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:35.887117 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:35.887162 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:35.889529 (+ 2367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:45131: BlockingRecv error: recv got EOF from 127.9.187.193:45131 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":67,"threads_started":1}
Aug 08 17:41:36 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:36 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:36.015125 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:36.010682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:38147)
0808 17:41:36.010843 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:36.010853 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:36.010918 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:36.011063 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:36.011064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:36.011238 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:36.011286 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:36.011288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.011902 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.011903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:36.012454 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:36.012456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.012747 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.012747 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:36.012791 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:36.013189 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:36.013193 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:36.015063 (+ 1870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
W20260808 17:41:36.015241 25064 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:36.010744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:38147 (local address 127.9.187.254:40753)
0808 17:41:36.010810 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:36.010813 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:36.010919 (+ 106us) server_negotiation.cc:407] Connection header received
0808 17:41:36.010978 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:36.010979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:36.010993 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:36.011047 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:36.011347 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.011838 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.012514 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.012690 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.012745 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:36.015174 (+ 2429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:38147: BlockingRecv error: recv got EOF from 127.9.187.194:38147 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 17:41:36 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:36 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:36.142652 25066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:36.138461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:46183)
0808 17:41:36.138642 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:36.138653 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:36.138717 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:36.138829 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:36.138830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:36.139012 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:36.139070 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:36.139071 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.139661 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.139662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:36.140199 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:36.140200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.140471 (+ 271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.140472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:36.140510 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:36.140898 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:36.140902 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:36.142586 (+ 1684us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":90,"threads_started":1}
W20260808 17:41:36.142751 25064 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:36.138515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:46183 (local address 127.9.187.254:40753)
0808 17:41:36.138563 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:36.138565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:36.138711 (+ 146us) server_negotiation.cc:407] Connection header received
0808 17:41:36.138762 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:36.138762 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:36.138777 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:36.138817 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:36.139120 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.139608 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.140254 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.140424 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.140467 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:36.142675 (+ 2208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:46183: BlockingRecv error: recv got EOF from 127.9.187.195:46183 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 17:41:36 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:36 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:36.894405 25067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:36.889992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:52063)
0808 17:41:36.890165 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:36.890179 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:36.890240 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:36.890391 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:36.890392 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:36.890559 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:36.890610 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:36.890612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.891218 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.891219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:36.891764 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:36.891766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.892071 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.892072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:36.892112 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:36.892573 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:36.892577 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:36.894343 (+ 1766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":61,"threads_started":1}
W20260808 17:41:36.894518 25068 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:36.890113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:52063 (local address 127.9.187.254:40753)
0808 17:41:36.890285 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:36.890287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:36.890295 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:41:36.890315 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:36.890316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:36.890327 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:36.890380 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:36.890660 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.891161 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.891824 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:36.892019 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:36.892066 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:36.894444 (+ 2378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:52063: BlockingRecv error: recv got EOF from 127.9.187.193:52063 (error 108)
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":105,"threads_started":1}
Aug 08 17:41:37 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:37 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:37.020192 25069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:37.015616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:46689)
0808 17:41:37.015818 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:37.015828 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:37.015897 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:37.016041 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:37.016042 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:37.016236 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:37.016288 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:37.016291 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.017034 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.017035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:37.017577 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:37.017579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.017900 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.017901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:37.017956 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:37.018389 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:37.018394 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:37.020122 (+ 1728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
W20260808 17:41:37.020274 25068 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:37.015682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:46689 (local address 127.9.187.254:40753)
0808 17:41:37.015750 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:37.015752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:37.015890 (+ 138us) server_negotiation.cc:407] Connection header received
0808 17:41:37.015951 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:37.015952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:37.015968 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:37.016022 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:37.016348 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.016978 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.017632 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.017843 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.017896 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:37.020211 (+ 2315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:46689: BlockingRecv error: recv got EOF from 127.9.187.194:46689 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 17:41:37 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:37 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:37.147979 25070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:37.143104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:34841)
0808 17:41:37.143255 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:37.143266 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:37.143329 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:37.143486 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:37.143487 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:37.143720 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:37.143782 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:37.143784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.144515 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.144515 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:37.145071 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:37.145074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.145444 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.145445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:37.145495 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:37.145988 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:37.145994 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:37.147917 (+ 1923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":86,"threads_started":1}
W20260808 17:41:37.148102 25068 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:37.143158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:34841 (local address 127.9.187.254:40753)
0808 17:41:37.143237 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:37.143239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:37.143330 (+ 91us) server_negotiation.cc:407] Connection header received
0808 17:41:37.143376 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:37.143377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:37.143392 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:37.143470 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:37.143856 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.144433 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.145160 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.145363 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.145426 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:37.148036 (+ 2610us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:34841: BlockingRecv error: recv got EOF from 127.9.187.195:34841 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 17:41:37 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:37 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:37.902372 25072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:37.894858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:57321)
0808 17:41:37.894994 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:37.895004 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:37.895055 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:37.895209 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:37.895210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:37.895380 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:37.895427 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:37.895429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.896068 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.896068 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:37.896627 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:37.896630 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.896994 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.896995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:37.897032 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:37.900380 (+ 3348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:37.900384 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:37.902280 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":63,"threads_started":1}
W20260808 17:41:37.902446 25073 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:37.894915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:57321 (local address 127.9.187.254:40753)
0808 17:41:37.895043 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:37.895045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:37.895055 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:37.895104 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:37.895105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:37.895116 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:37.895187 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:37.895490 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.896001 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.896719 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:37.896932 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:37.896992 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:37.902383 (+ 5391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:57321: BlockingRecv error: recv got EOF from 127.9.187.193:57321 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":57,"threads_started":1}
Aug 08 17:41:38 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:38 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:38.025039 25074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:38.020610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:52875)
0808 17:41:38.020734 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:38.020744 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:38.020806 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:38.020941 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:38.020942 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:38.021120 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:38.021170 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:38.021171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.021826 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.021827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:38.022396 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:38.022398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.022725 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.022726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:38.022779 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:38.023233 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:38.023238 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:38.024959 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
W20260808 17:41:38.025127 25073 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:38.020675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:52875 (local address 127.9.187.254:40753)
0808 17:41:38.020726 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:38.020728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:38.020804 (+ 76us) server_negotiation.cc:407] Connection header received
0808 17:41:38.020868 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:38.020869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:38.020882 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:38.020930 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:38.021241 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.021751 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.022468 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.022664 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.022721 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:38.025063 (+ 2342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:52875: BlockingRecv error: recv got EOF from 127.9.187.194:52875 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 08 17:41:38 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:38 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:38.153144 25076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:38.148466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:54675)
0808 17:41:38.148625 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:38.148637 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:38.148698 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:38.148874 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:38.148875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:38.149101 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:38.149163 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:38.149166 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.149804 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.149805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:38.150382 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:38.150384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.150870 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.150871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:38.150919 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:38.151360 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:38.151364 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:38.153074 (+ 1710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
W20260808 17:41:38.153260 25073 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:38.148590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:54675 (local address 127.9.187.254:40753)
0808 17:41:38.148666 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:38.148668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:38.148682 (+ 14us) server_negotiation.cc:407] Connection header received
0808 17:41:38.148778 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:38.148779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:38.148796 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:38.148848 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:38.149230 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.149743 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.150475 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.150777 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.150870 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:38.153188 (+ 2318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:54675: BlockingRecv error: recv got EOF from 127.9.187.195:54675 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 17:41:38 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:38 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:38.907501 25081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:38.902868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:48567)
0808 17:41:38.903004 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:38.903013 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:38.903063 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:38.903245 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:38.903246 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:38.903415 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:38.903466 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:38.903468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.904179 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.904180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:38.904704 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:38.904706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.905030 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.905031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:38.905073 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:38.905604 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:38.905609 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:38.907440 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
W20260808 17:41:38.907691 25082 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:38.902981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:48567 (local address 127.9.187.254:40753)
0808 17:41:38.903124 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:38.903126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:38.903135 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:38.903157 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:38.903158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:38.903167 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:38.903227 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:38.903586 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.904107 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.904774 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:38.904973 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:38.905027 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:38.907615 (+ 2588us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:48567: BlockingRecv error: recv got EOF from 127.9.187.193:48567 (error 108)
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":65,"threads_started":1}
Aug 08 17:41:39 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:39 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:39.029901 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:39.025479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:35967)
0808 17:41:39.025647 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:39.025658 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:39.025731 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:39.025872 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:39.025873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:39.026056 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:39.026105 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:39.026107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.026771 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.026772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:39.027296 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:39.027297 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.027638 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.027639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:39.027696 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:39.028143 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:39.028147 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:39.029811 (+ 1664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":71,"threads_started":1}
W20260808 17:41:39.029969 25082 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:39.025541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:35967 (local address 127.9.187.254:40753)
0808 17:41:39.025634 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:39.025637 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:39.025723 (+ 86us) server_negotiation.cc:407] Connection header received
0808 17:41:39.025800 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:39.025800 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:39.025814 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:39.025859 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:39.026199 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.026699 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.027374 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.027574 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.027632 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:39.029915 (+ 2283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:35967: BlockingRecv error: recv got EOF from 127.9.187.194:35967 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 17:41:39 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:39 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:39.158036 25084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:39.153608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:50511)
0808 17:41:39.153766 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:39.153778 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:39.153850 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:39.153979 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:39.153980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:39.154192 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:39.154241 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:39.154243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.154900 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.154901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:39.155429 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:39.155431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.155760 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.155761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:39.155819 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:39.156227 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:39.156231 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:39.157949 (+ 1718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":75,"threads_started":1}
W20260808 17:41:39.158113 25082 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:39.153722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:50511 (local address 127.9.187.254:40753)
0808 17:41:39.153770 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:39.153773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:39.153842 (+ 69us) server_negotiation.cc:407] Connection header received
0808 17:41:39.153903 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:39.153904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:39.153919 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:39.153965 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:39.154314 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.154817 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.155506 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.155699 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.155753 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:39.158051 (+ 2298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:50511: BlockingRecv error: recv got EOF from 127.9.187.195:50511 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 08 17:41:39 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:39 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:39.912617 25085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:39.907998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:45459)
0808 17:41:39.908172 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:39.908183 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:39.908242 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:39.908368 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:39.908369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:39.908551 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:39.908603 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:39.908604 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.909225 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.909227 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:39.909826 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:39.909828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.910164 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.910165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:39.910228 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:39.910702 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:39.910708 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:39.912527 (+ 1819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":102,"threads_started":1}
W20260808 17:41:39.912707 25087 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:39.908119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:45459 (local address 127.9.187.254:40753)
0808 17:41:39.908238 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:39.908240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:39.908250 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:39.908290 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:39.908291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:39.908301 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:39.908356 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:39.908657 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.909157 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.909888 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:39.910069 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:39.910113 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:39.912630 (+ 2517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:45459: BlockingRecv error: recv got EOF from 127.9.187.193:45459 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":52,"threads_started":1}
Aug 08 17:41:40 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:40 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:40.034657 25089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:40.030348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:58879)
0808 17:41:40.030474 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:40.030485 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:40.030542 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:40.030676 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:40.030677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:40.030849 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:40.030903 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:40.030904 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.031511 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.031511 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:40.032048 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:40.032049 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.032348 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.032349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:40.032386 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:40.032798 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:40.032803 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:40.034565 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
W20260808 17:41:40.034722 25087 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:40.030431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:58879 (local address 127.9.187.254:40753)
0808 17:41:40.030483 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:40.030485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:40.030536 (+ 51us) server_negotiation.cc:407] Connection header received
0808 17:41:40.030599 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:40.030600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:40.030611 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:40.030651 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:40.030957 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.031455 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.032121 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.032301 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.032343 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:40.034670 (+ 2327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:58879: BlockingRecv error: recv got EOF from 127.9.187.194:58879 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 17:41:40 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:40 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:40.162907 25090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:40.158497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:39783)
0808 17:41:40.158647 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:40.158656 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:40.158717 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:40.158846 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:40.158846 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:40.159027 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:40.159072 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:40.159074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.159704 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.159705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:40.160256 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:40.160258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.160585 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.160586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:40.160643 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:40.161081 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:40.161086 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:40.162817 (+ 1731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":97,"threads_started":1}
W20260808 17:41:40.162967 25087 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:40.158551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:39783 (local address 127.9.187.254:40753)
0808 17:41:40.158602 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:40.158604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:40.158708 (+ 104us) server_negotiation.cc:407] Connection header received
0808 17:41:40.158770 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:40.158771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:40.158786 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:40.158829 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:40.159140 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.159633 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.160335 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.160524 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.160579 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:40.162915 (+ 2336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:39783: BlockingRecv error: recv got EOF from 127.9.187.195:39783 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 08 17:41:40 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:40 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:40.917631 25091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:40.913125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:44061)
0808 17:41:40.913297 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:40.913308 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:40.913365 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:40.913493 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:40.913494 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:40.913694 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:40.913744 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:40.913746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.914388 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.914389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:40.914967 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:40.914969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.915350 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.915351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:40.915406 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:40.915878 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:40.915883 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:40.917570 (+ 1687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":93,"threads_started":1}
W20260808 17:41:40.917749 25094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:40.913175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:44061 (local address 127.9.187.254:40753)
0808 17:41:40.913300 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:40.913302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:40.913352 (+ 50us) server_negotiation.cc:407] Connection header received
0808 17:41:40.913421 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:40.913422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:40.913433 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:40.913480 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:40.913797 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.914324 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.915062 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:40.915268 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:40.915331 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:40.917673 (+ 2342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:44061: BlockingRecv error: recv got EOF from 127.9.187.193:44061 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
Aug 08 17:41:41 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:41 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:41.039794 25095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:41.035144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:53003)
0808 17:41:41.035299 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:41.035313 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:41.035394 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:41.035554 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:41.035555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:41.035755 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:41.035805 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:41.035807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.036478 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.036479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:41.037035 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:41.037038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.037397 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.037398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:41.037457 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:41.037901 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:41.037906 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:41.039730 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":71,"threads_started":1}
W20260808 17:41:41.039893 25094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:41.035225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:53003 (local address 127.9.187.254:40753)
0808 17:41:41.035303 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:41.035305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:41.035380 (+ 75us) server_negotiation.cc:407] Connection header received
0808 17:41:41.035468 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:41.035469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:41.035482 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:41.035542 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:41.035885 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.036395 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.037126 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.037319 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.037377 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:41.039833 (+ 2456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:53003: BlockingRecv error: recv got EOF from 127.9.187.194:53003 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 17:41:41 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:41 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:41.167949 25096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:41.163408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:58889)
0808 17:41:41.163591 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:41.163607 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:41.163684 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:41.163826 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:41.163826 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:41.164011 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:41.164061 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:41.164063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.164704 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.164706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:41.165236 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:41.165238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.165578 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.165579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:41.165635 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:41.166057 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:41.166063 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:41.167863 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
W20260808 17:41:41.168030 25094 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:41.163517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:58889 (local address 127.9.187.254:40753)
0808 17:41:41.163580 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:41.163583 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:41.163673 (+ 90us) server_negotiation.cc:407] Connection header received
0808 17:41:41.163749 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:41.163750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:41.163763 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:41.163811 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:41.164136 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.164633 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.165326 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.165510 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.165566 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:41.167966 (+ 2400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:58889: BlockingRecv error: recv got EOF from 127.9.187.195:58889 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 17:41:41 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:41 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:41.922649 25097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:41.918066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:39611)
0808 17:41:41.918217 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:41.918228 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:41.918297 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:41.918414 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:41.918415 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:41.918585 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:41.918675 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:41.918677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.919333 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.919334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:41.919904 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:41.919906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.920284 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.920285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:41.920340 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:41.920806 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:41.920811 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:41.922588 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
W20260808 17:41:41.922771 25098 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:41.918148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:39611 (local address 127.9.187.254:40753)
0808 17:41:41.918248 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:41.918250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:41.918280 (+ 30us) server_negotiation.cc:407] Connection header received
0808 17:41:41.918344 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:41.918344 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:41.918355 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:41.918409 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:41.918753 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.919263 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.919998 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:41.920209 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:41.920272 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:41.922689 (+ 2417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:39611: BlockingRecv error: recv got EOF from 127.9.187.193:39611 (error 108)
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":50,"threads_started":1}
Aug 08 17:41:42 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:42 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:42.045171 25099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:42.040240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:34713)
0808 17:41:42.040380 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:42.040392 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:42.040453 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:42.040591 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:42.040593 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:42.040772 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:42.040817 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:42.040819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.041491 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.041492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:42.042396 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:42.042399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.042768 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.042769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:42.042825 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:42.043315 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:42.043320 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:42.045095 (+ 1775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":62,"threads_started":1}
W20260808 17:41:42.045253 25098 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:42.040364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:34713 (local address 127.9.187.254:40753)
0808 17:41:42.040428 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:42.040429 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:42.040438 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:42.040508 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:42.040509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:42.040522 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:42.040580 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:42.040888 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.041418 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.042482 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.042702 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.042762 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:42.045183 (+ 2421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:34713: BlockingRecv error: recv got EOF from 127.9.187.194:34713 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 17:41:42 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:42 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:42.173077 25101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:42.168361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:46107)
0808 17:41:42.168492 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:42.168504 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:42.168570 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:42.168696 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:42.168696 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:42.168889 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:42.168937 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:42.168939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.169590 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.169591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:42.170373 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:42.170377 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.170700 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.170701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:42.170766 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:42.171187 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:42.171191 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:42.173006 (+ 1815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
W20260808 17:41:42.173171 25098 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:42.168420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:46107 (local address 127.9.187.254:40753)
0808 17:41:42.168473 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:42.168475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:42.168561 (+ 86us) server_negotiation.cc:407] Connection header received
0808 17:41:42.168622 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:42.168623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:42.168638 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:42.168681 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:42.169011 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.169517 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.170455 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.170641 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.170696 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:42.173111 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:46107: BlockingRecv error: recv got EOF from 127.9.187.195:46107 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 08 17:41:42 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:42 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:42.931242 25104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:42.923077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:40525)
0808 17:41:42.923208 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:42.923218 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:42.923265 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:42.923390 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:42.923390 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:42.923584 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:42.923635 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:42.923637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.924246 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.924247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:42.924881 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:42.924884 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.925326 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.925327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:42.925372 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:42.929376 (+ 4004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:42.929381 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:42.931171 (+ 1790us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
W20260808 17:41:42.931345 25106 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:42.923115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:40525 (local address 127.9.187.254:40753)
0808 17:41:42.923259 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:42.923261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:42.923270 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:41:42.923307 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:42.923308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:42.923318 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:42.923377 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:42.923688 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.924188 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.924955 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:42.925264 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:42.925317 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:42.931270 (+ 5953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:40525: BlockingRecv error: recv got EOF from 127.9.187.193:40525 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
Aug 08 17:41:43 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:43 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:43.050359 25107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:43.045616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:58673)
0808 17:41:43.045767 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:43.045777 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:43.045831 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:43.045989 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:43.045990 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:43.046180 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:43.046229 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:43.046231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.046956 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.046957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:43.047493 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:43.047494 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.047834 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.047835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:43.047874 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:43.048331 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:43.048335 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:43.050297 (+ 1962us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":78,"threads_started":1}
W20260808 17:41:43.050465 25106 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:43.045657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:58673 (local address 127.9.187.254:40753)
0808 17:41:43.045704 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:43.045706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:43.045825 (+ 119us) server_negotiation.cc:407] Connection header received
0808 17:41:43.045876 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:43.045877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:43.045887 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:43.045938 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:43.046325 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.046885 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.047580 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.047776 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.047836 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:43.050399 (+ 2563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:58673: BlockingRecv error: recv got EOF from 127.9.187.194:58673 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 17:41:43 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:43 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.195@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:43.177990 25108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:43.173528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.195:39099)
0808 17:41:43.173668 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:43.173680 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:43.173750 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:43.173878 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:43.173879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:43.174064 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:43.174112 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:43.174113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.174809 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.174810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:43.175378 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:43.175381 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.175706 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.175707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:43.175764 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:43.176208 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:43.176212 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:43.177930 (+ 1718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
W20260808 17:41:43.178089 25106 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:43.173599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:39099 (local address 127.9.187.254:40753)
0808 17:41:43.173672 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:43.173674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:43.173738 (+ 64us) server_negotiation.cc:407] Connection header received
0808 17:41:43.173802 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:43.173803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:43.173818 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:43.173862 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:43.174229 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.174738 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.175451 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.175647 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.175702 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:43.178026 (+ 2324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.195:39099: BlockingRecv error: recv got EOF from 127.9.187.195:39099 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 17:41:43 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:43 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.193@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:43.936126 25110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:43.931779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.193:41961)
0808 17:41:43.931911 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:43.931921 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:43.931975 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:43.932095 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:43.932095 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:43.932261 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:43.932311 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:43.932313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.932935 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.932936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:43.933471 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:43.933473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.933776 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.933777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:43.933814 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:43.934246 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:43.934250 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:43.936047 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
W20260808 17:41:43.936280 25111 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:43.931862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:41961 (local address 127.9.187.254:40753)
0808 17:41:43.931961 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:43.931963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:43.931973 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:43.932019 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:43.932020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:43.932030 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:43.932084 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:43.932359 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.932867 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.933542 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:43.933722 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:43.933770 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:43.936170 (+ 2400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.193:41961: BlockingRecv error: recv got EOF from 127.9.187.193:41961 (error 108)
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":50,"threads_started":1}
Aug 08 17:41:44 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:41:44 dist-test-slave-bqcl krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.187.194@KRBTEST.COM for oryx/127.9.187.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:41:44.055405 25112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:44.050819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40753 (local address 127.9.187.194:40471)
0808 17:41:44.050974 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:44.050988 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:44.051067 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:44.051197 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:44.051198 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:44.051371 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:44.051418 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:44.051420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.052103 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.052103 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:44.052644 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:44.052645 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.052975 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.052976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:44.053028 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:44.053525 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:44.053530 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:44.055315 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.187.254:40753: Server oryx/127.9.187.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":73,"threads_started":1}
W20260808 17:41:44.055472 25111 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:44.050901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:40471 (local address 127.9.187.254:40753)
0808 17:41:44.050983 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:44.050985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:44.051041 (+ 56us) server_negotiation.cc:407] Connection header received
0808 17:41:44.051124 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:44.051125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:44.051137 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:44.051182 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:44.051491 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.052016 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.052726 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.052916 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.052971 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:44.055417 (+ 2446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.187.194:40471: BlockingRecv error: recv got EOF from 127.9.187.194:40471 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 17:41:44.095772 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 24369
I20260808 17:41:44.121987 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 24611
I20260808 17:41:44.138638 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 24817
I20260808 17:41:44.161171 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 24265
2026-08-08T17:41:44Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17688 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T17:41:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:44Z Disabled control of system clock
I20260808 17:41:44.192276 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:35199
--webserver_interface=127.9.187.254
--webserver_port=0
--builtin_ntp_servers=127.9.187.212:40065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:35199
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 17:41:44.274408 25117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:44.274605 25117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:44.274624 25117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:44.275743 25117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:44.275777 25117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:44.275789 25117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:44.275800 25117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:44.275811 25117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:44.277154 25117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:35199
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:35199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:44.277349 25117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:44.277593 25117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:44.282285 25133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:44.282251 25131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:44.282248 25128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:44.282547 25117 server_base.cc:1034] running on GCE node
I20260808 17:41:44.282799 25117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:44.283082 25117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:44.284260 25117 hybrid_clock.cc:648] HybridClock initialized: now 1786210904284242 us; error 29 us; skew 500 ppm
I20260808 17:41:44.285616 25117 webserver.cc:460] Webserver started at http://127.9.187.254:39425/ using document root <none> and password file <none>
I20260808 17:41:44.285864 25117 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:44.285919 25117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:44.286068 25117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:44.287173 25117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "fe2f3ae29caa4161acd76b06e2bd9743"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "c07db7f7433f70e7be63fc8f5b78cbf6"
server_key_iv: "d3d49e21dfcba5453f099ac0787de6ff"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.287555 25117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "fe2f3ae29caa4161acd76b06e2bd9743"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "c07db7f7433f70e7be63fc8f5b78cbf6"
server_key_iv: "d3d49e21dfcba5453f099ac0787de6ff"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.288928 25117 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:44.289631 25141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.289791 25117 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:44.289893 25117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "fe2f3ae29caa4161acd76b06e2bd9743"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "c07db7f7433f70e7be63fc8f5b78cbf6"
server_key_iv: "d3d49e21dfcba5453f099ac0787de6ff"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.289959 25117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:44.305162 25117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:44.305459 25117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:44.305603 25117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:44.309669 25117 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:35199
I20260808 17:41:44.309707 25229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:35199 every 8 connection(s)
I20260808 17:41:44.310038 25117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:44.310767 25230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:44.313303 25230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743: Bootstrap starting.
I20260808 17:41:44.313891 25230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:44.314221 25230 log.cc:824] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:44.314867 25230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743: No bootstrap required, opened a new log
I20260808 17:41:44.316445 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 25117
I20260808 17:41:44.316550 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:44.316478 25230 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f3ae29caa4161acd76b06e2bd9743" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35199 } }
I20260808 17:41:44.316648 25230 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:44.316689 25230 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2f3ae29caa4161acd76b06e2bd9743, State: Initialized, Role: FOLLOWER
I20260808 17:41:44.316749 9967 external_mini_cluster.cc:1428] Setting key ea579ddd69155acd9449d6a57152e1dc
I20260808 17:41:44.316850 25230 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f3ae29caa4161acd76b06e2bd9743" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35199 } }
I20260808 17:41:44.316937 25230 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:44.316968 25230 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:44.317018 25230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:44.317613 25230 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f3ae29caa4161acd76b06e2bd9743" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35199 } }
I20260808 17:41:44.317705 25230 leader_election.cc:302] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe2f3ae29caa4161acd76b06e2bd9743; no voters:
I20260808 17:41:44.317909 25230 leader_election.cc:288] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:44.317952 25239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:44.318086 25239 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [term 1 LEADER]: Becoming Leader. State: Replica: fe2f3ae29caa4161acd76b06e2bd9743, State: Running, Role: LEADER
I20260808 17:41:44.318194 25230 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:44.318276 25239 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f3ae29caa4161acd76b06e2bd9743" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35199 } }
I20260808 17:41:44.318620 25239 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe2f3ae29caa4161acd76b06e2bd9743. Latest consensus state: current_term: 1 leader_uuid: "fe2f3ae29caa4161acd76b06e2bd9743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f3ae29caa4161acd76b06e2bd9743" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35199 } } }
I20260808 17:41:44.318768 25239 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:44.319029 25251 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:44.319264 25242 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe2f3ae29caa4161acd76b06e2bd9743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f3ae29caa4161acd76b06e2bd9743" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35199 } } }
I20260808 17:41:44.319339 25242 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:44.319597 25251 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:44.321014 25251 catalog_manager.cc:1347] Generated new cluster ID: 60e67dc7acff4056a09b80bf712ff75e
I20260808 17:41:44.321071 25251 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:44.322634 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:44.317253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41792 (local address 127.9.187.254:35199)
0808 17:41:44.317468 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:44.317478 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:44.317504 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:41:44.317608 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:44.317613 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:44.317674 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:44.317807 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:44.318019 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.319723 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.320648 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.321239 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.321357 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:44.321943 (+ 586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:44.321947 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:44.321947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:44.322164 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:44.322205 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:44.322219 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:44.322280 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:44.322351 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 17:41:44.322425 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":137,"thread_start_us":88,"threads_started":1}
I20260808 17:41:44.338868 25251 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:44.339365 25251 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:44.346820 25251 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe2f3ae29caa4161acd76b06e2bd9743: Generated new TSK 0
I20260808 17:41:44.346975 25251 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:41:44.348220 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:35199
--builtin_ntp_servers=127.9.187.212:40065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 17:41:44.432827 25269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:44.433023 25269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:44.433053 25269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:44.434175 25269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:44.434216 25269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:44.434247 25269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:44.435520 25269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:35199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:44.435746 25269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:44.436007 25269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:44.440804 25283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:44.440831 25277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:44.440811 25279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:44.440963 25269 server_base.cc:1034] running on GCE node
I20260808 17:41:44.441198 25269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:44.441422 25269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:44.442569 25269 hybrid_clock.cc:648] HybridClock initialized: now 1786210904442548 us; error 37 us; skew 500 ppm
I20260808 17:41:44.443740 25269 webserver.cc:460] Webserver started at http://127.9.187.193:40011/ using document root <none> and password file <none>
I20260808 17:41:44.443941 25269 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:44.443989 25269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:44.444133 25269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:44.445125 25269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "132bcc38e46a42b0a097dc730833c5c3"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "04be562d976d70693961675231331545"
server_key_iv: "d5b4f1dd71a778610c7c32f000508ef5"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.445461 25269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "132bcc38e46a42b0a097dc730833c5c3"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "04be562d976d70693961675231331545"
server_key_iv: "d5b4f1dd71a778610c7c32f000508ef5"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.446719 25269 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:44.447373 25293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.447525 25269 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:41:44.447609 25269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "132bcc38e46a42b0a097dc730833c5c3"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "04be562d976d70693961675231331545"
server_key_iv: "d5b4f1dd71a778610c7c32f000508ef5"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.447669 25269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:44.455113 25269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:44.455349 25269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:44.455464 25269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:44.455646 25269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:44.455926 25269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:44.455958 25269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.455984 25269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:44.456008 25269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.461252 25269 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:42071
I20260808 17:41:44.461313 25481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:42071 every 8 connection(s)
I20260808 17:41:44.461571 25269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:41:44.466146 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:44.462287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:51115 (local address 127.9.187.254:35199)
0808 17:41:44.462333 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:44.462335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:44.462546 (+ 211us) server_negotiation.cc:407] Connection header received
0808 17:41:44.462975 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:44.462976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:44.462988 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:44.463035 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:44.463613 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.464098 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.465002 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.465181 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.465224 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:44.465909 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:44.465910 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:44.465910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:44.465915 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:44.465929 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:44.465933 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:44.465972 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:44.466035 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 17:41:44.466064 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:41:44.466346 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:44.462268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:35199 (local address 127.9.187.193:51115)
0808 17:41:44.462439 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:44.462470 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:44.462899 (+ 429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:44.463089 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:44.463091 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:44.463099 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:44.463554 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:44.463558 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.464156 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.464156 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:44.464938 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:44.464941 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.465262 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.465263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:44.465375 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:44.465786 (+ 411us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:44.465786 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:44.465813 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:44.465835 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:44.465980 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:44.465982 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:44.465984 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:41:44.466029 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:41:44.466111 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":87,"threads_started":1}
I20260808 17:41:44.466814 25482 heartbeater.cc:347] Connected to a master server at 127.9.187.254:35199
I20260808 17:41:44.466926 25482 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:44.467070 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 25269
I20260808 17:41:44.467104 25482 heartbeater.cc:511] Master 127.9.187.254:35199 requested a full tablet report, sending...
I20260808 17:41:44.467150 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:44.467347 9967 external_mini_cluster.cc:1428] Setting key 2e947c07bd475a43134b4d781b193f6f
I20260808 17:41:44.467667 25168 ts_manager.cc:194] Registered new tserver with Master: 132bcc38e46a42b0a097dc730833c5c3 (127.9.187.193:42071)
I20260808 17:41:44.468369 25168 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.193:51115
I20260808 17:41:44.468387 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:35199
--builtin_ntp_servers=127.9.187.212:40065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 17:41:44.548950 25487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:44.549154 25487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:44.549175 25487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:44.550287 25487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:44.550324 25487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:44.550347 25487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:44.551661 25487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:35199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:44.551842 25487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:44.552096 25487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:44.556806 25495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:44.556861 25494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:44.556857 25499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:44.556900 25487 server_base.cc:1034] running on GCE node
I20260808 17:41:44.557229 25487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:44.557478 25487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:44.558619 25487 hybrid_clock.cc:648] HybridClock initialized: now 1786210904558603 us; error 29 us; skew 500 ppm
I20260808 17:41:44.559857 25487 webserver.cc:460] Webserver started at http://127.9.187.194:40033/ using document root <none> and password file <none>
I20260808 17:41:44.560078 25487 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:44.560128 25487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:44.560272 25487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:44.561291 25487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "191b937db3634c30b4dab73072ed1326"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "ba1f9a79e74a29a38a4ef6f2a2ba8850"
server_key_iv: "b99adcc4de17c2a36c8f31f9aa7de781"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.561626 25487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "191b937db3634c30b4dab73072ed1326"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "ba1f9a79e74a29a38a4ef6f2a2ba8850"
server_key_iv: "b99adcc4de17c2a36c8f31f9aa7de781"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.562966 25487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:41:44.563655 25507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.563804 25487 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:44.563889 25487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "191b937db3634c30b4dab73072ed1326"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "ba1f9a79e74a29a38a4ef6f2a2ba8850"
server_key_iv: "b99adcc4de17c2a36c8f31f9aa7de781"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.563957 25487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:44.577944 25487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:44.578226 25487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:44.578359 25487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:44.578559 25487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:44.578852 25487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:44.578886 25487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.578914 25487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:44.578931 25487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.584290 25487 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:39921
I20260808 17:41:44.584329 25703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:39921 every 8 connection(s)
I20260808 17:41:44.584649 25487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:41:44.589635 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:44.585326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:35237 (local address 127.9.187.254:35199)
0808 17:41:44.585386 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:44.585388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:44.585598 (+ 210us) server_negotiation.cc:407] Connection header received
0808 17:41:44.586103 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:44.586104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:44.586117 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:44.586184 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:44.586865 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.587365 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.588328 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.588534 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.588590 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:44.589368 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:44.589370 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:44.589370 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:44.589375 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:44.589391 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:44.589395 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:44.589440 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:44.589524 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 17:41:44.589554 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:41:44.589826 25709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:44.585313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:35199 (local address 127.9.187.194:35237)
0808 17:41:44.585487 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:44.585520 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:44.586003 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:44.586270 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:44.586275 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:44.586284 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:44.586768 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:44.586773 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.587450 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.587451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:44.588238 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:44.588240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.588603 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.588604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:44.588733 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:44.589215 (+ 482us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:44.589216 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:44.589256 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:44.589279 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:44.589448 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:44.589453 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:44.589457 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:44.589519 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 17:41:44.589621 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":70,"threads_started":1}
I20260808 17:41:44.590283 25705 heartbeater.cc:347] Connected to a master server at 127.9.187.254:35199
I20260808 17:41:44.590368 25705 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:44.590520 25705 heartbeater.cc:511] Master 127.9.187.254:35199 requested a full tablet report, sending...
I20260808 17:41:44.590853 25168 ts_manager.cc:194] Registered new tserver with Master: 191b937db3634c30b4dab73072ed1326 (127.9.187.194:39921)
I20260808 17:41:44.591192 25168 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.194:35237
I20260808 17:41:44.593886 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 25487
I20260808 17:41:44.593966 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:44.594170 9967 external_mini_cluster.cc:1428] Setting key 9035b053cd600389a064dcd88890a27a
I20260808 17:41:44.595052 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:35199
--builtin_ntp_servers=127.9.187.212:40065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 17:41:44.676256 25711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:44.676443 25711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:44.676462 25711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:44.677518 25711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:44.677551 25711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:44.677573 25711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:44.678844 25711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:35199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:44.679059 25711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:44.679314 25711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:44.683858 25717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:44.683900 25711 server_base.cc:1034] running on GCE node
W20260808 17:41:44.683884 25718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:44.683871 25721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:44.684302 25711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:44.684538 25711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:44.685672 25711 hybrid_clock.cc:648] HybridClock initialized: now 1786210904685660 us; error 28 us; skew 500 ppm
I20260808 17:41:44.686909 25711 webserver.cc:460] Webserver started at http://127.9.187.195:46407/ using document root <none> and password file <none>
I20260808 17:41:44.687134 25711 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:44.687178 25711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:44.687321 25711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:44.688323 25711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "a35be958f60040858740e0e0ca3f186f"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "1216cbcfb79f42f886da0e523fccb514"
server_key_iv: "c7c39071f1fdfaac76fd4168053dc302"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.688642 25711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "a35be958f60040858740e0e0ca3f186f"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "1216cbcfb79f42f886da0e523fccb514"
server_key_iv: "c7c39071f1fdfaac76fd4168053dc302"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.689827 25711 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:44.690549 25728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.690706 25711 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.690785 25711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "a35be958f60040858740e0e0ca3f186f"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "1216cbcfb79f42f886da0e523fccb514"
server_key_iv: "c7c39071f1fdfaac76fd4168053dc302"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.690850 25711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:44.707804 25711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:44.708056 25711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:44.708169 25711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:44.708388 25711 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:44.708689 25711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:44.708722 25711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.708750 25711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:44.708767 25711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.714229 25711 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:40081
I20260808 17:41:44.714280 25912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:40081 every 8 connection(s)
I20260808 17:41:44.714583 25711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:41:44.719609 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:44.715209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:46105 (local address 127.9.187.254:35199)
0808 17:41:44.715258 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:44.715260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:44.715489 (+ 229us) server_negotiation.cc:407] Connection header received
0808 17:41:44.715997 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:44.715998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:44.716012 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:44.716067 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:44.716731 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.717222 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.718294 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.718516 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.718577 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:44.719345 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:44.719346 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:44.719347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:44.719351 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:44.719368 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:44.719372 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:44.719416 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:44.719494 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 17:41:44.719529 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:41:44.719820 25917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:44.715199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:35199 (local address 127.9.187.195:46105)
0808 17:41:44.715373 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:44.715406 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:44.715898 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:44.716135 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:44.716139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:44.716150 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:44.716639 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:44.716644 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.717311 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.717312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:44.718205 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:44.718208 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:44.718586 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:44.718587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:44.718716 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:44.719207 (+ 491us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:44.719208 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:44.719238 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:44.719262 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:44.719422 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:44.719427 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:44.719430 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:44.719492 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 17:41:44.719623 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260808 17:41:44.720122 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 25711
I20260808 17:41:44.720214 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:44.720283 25913 heartbeater.cc:347] Connected to a master server at 127.9.187.254:35199
I20260808 17:41:44.720394 25913 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:44.720399 9967 external_mini_cluster.cc:1428] Setting key 383ce1e59db568d2acf0247815e69f3e
I20260808 17:41:44.720577 25913 heartbeater.cc:511] Master 127.9.187.254:35199 requested a full tablet report, sending...
I20260808 17:41:44.720940 25168 ts_manager.cc:194] Registered new tserver with Master: a35be958f60040858740e0e0ca3f186f (127.9.187.195:40081)
I20260808 17:41:44.721330 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:41:44.721470 25168 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.195:46105
W20260808 17:41:44.723117 25238 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:44.722669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41796 (local address 127.9.187.254:35199)
0808 17:41:44.722708 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:44.722711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:44.722826 (+ 115us) server_negotiation.cc:407] Connection header received
0808 17:41:44.722883 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:44.722884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:44.722896 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:44.722941 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:44.723061 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41796: BlockingRecv error: recv got EOF from 127.0.0.1:41796 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:41:44.723201 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 25269
I20260808 17:41:44.744825 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 25487
I20260808 17:41:44.757166 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 25711
I20260808 17:41:44.763103 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 25117
2026-08-08T17:41:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (601 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T17:41:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:44Z Disabled control of system clock
I20260808 17:41:44.794425 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:42497
--webserver_interface=127.9.187.254
--webserver_port=0
--builtin_ntp_servers=127.9.187.212:35749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:42497
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 17:41:44.873239 25930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:44.873431 25930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:44.873459 25930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:44.874590 25930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:44.874629 25930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:44.874646 25930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:44.874662 25930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:44.874676 25930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:44.875964 25930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:42497
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:42497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:44.876204 25930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:44.876466 25930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:44.881076 25936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:44.881050 25941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:44.881062 25935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:44.881280 25930 server_base.cc:1034] running on GCE node
I20260808 17:41:44.881522 25930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:44.881786 25930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:44.882920 25930 hybrid_clock.cc:648] HybridClock initialized: now 1786210904882907 us; error 30 us; skew 500 ppm
I20260808 17:41:44.883997 25930 webserver.cc:460] Webserver started at http://127.9.187.254:46475/ using document root <none> and password file <none>
I20260808 17:41:44.884227 25930 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:44.884277 25930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:44.884403 25930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:44.885396 25930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "f441d1764b1e460a89c1a6074ec00d5c"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "ee1220afbe29ddddbccf1c6fa6d5fe35"
server_key_iv: "be5920db658299756b2546f2dbdc3dbd"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.885707 25930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "f441d1764b1e460a89c1a6074ec00d5c"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "ee1220afbe29ddddbccf1c6fa6d5fe35"
server_key_iv: "be5920db658299756b2546f2dbdc3dbd"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.886906 25930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:41:44.887545 25954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:44.887688 25930 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:44.887769 25930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "f441d1764b1e460a89c1a6074ec00d5c"
format_stamp: "Formatted at 2026-08-08 17:41:44 on dist-test-slave-bqcl"
server_key: "ee1220afbe29ddddbccf1c6fa6d5fe35"
server_key_iv: "be5920db658299756b2546f2dbdc3dbd"
server_key_version: "encryptionkey@0"
I20260808 17:41:44.887830 25930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:44.890974 25930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:44.891211 25930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:44.891327 25930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:44.894871 25930 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:42497
I20260808 17:41:44.894902 26035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:42497 every 8 connection(s)
I20260808 17:41:44.895184 25930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:44.895781 26036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:44.898293 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 25930
I20260808 17:41:44.898363 26036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c: Bootstrap starting.
I20260808 17:41:44.898394 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:44.898571 9967 external_mini_cluster.cc:1428] Setting key c4380a859403f7f796e536458cffd41f
I20260808 17:41:44.898994 26036 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:44.899323 26036 log.cc:824] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:44.899935 26036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c: No bootstrap required, opened a new log
I20260808 17:41:44.900859 26039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:44.899044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42958 (local address 127.9.187.254:42497)
0808 17:41:44.899228 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:44.899236 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:44.899266 (+ 30us) server_negotiation.cc:407] Connection header received
0808 17:41:44.899689 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:44.899695 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:44.899733 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:44.899855 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:44.900473 (+ 618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:44.900477 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:44.900477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:44.900481 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:44.900521 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:44.900530 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:44.900611 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:44.900661 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 17:41:44.900716 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":76,"threads_started":1}
I20260808 17:41:44.901541 26036 raft_consensus.cc:348] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f441d1764b1e460a89c1a6074ec00d5c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42497 } }
I20260808 17:41:44.901671 26036 raft_consensus.cc:374] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:44.901703 26036 raft_consensus.cc:729] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f441d1764b1e460a89c1a6074ec00d5c, State: Initialized, Role: FOLLOWER
I20260808 17:41:44.901823 26036 consensus_queue.cc:260] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f441d1764b1e460a89c1a6074ec00d5c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42497 } }
I20260808 17:41:44.901894 26036 raft_consensus.cc:388] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:44.901924 26036 raft_consensus.cc:482] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:44.901969 26036 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:44.902786 26036 raft_consensus.cc:504] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f441d1764b1e460a89c1a6074ec00d5c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42497 } }
I20260808 17:41:44.902884 26036 leader_election.cc:302] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f441d1764b1e460a89c1a6074ec00d5c; no voters:
I20260808 17:41:44.903026 26036 leader_election.cc:288] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:44.903086 26041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:44.903259 26041 raft_consensus.cc:686] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [term 1 LEADER]: Becoming Leader. State: Replica: f441d1764b1e460a89c1a6074ec00d5c, State: Running, Role: LEADER
I20260808 17:41:44.903267 26036 sys_catalog.cc:564] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:44.903430 26041 consensus_queue.cc:237] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f441d1764b1e460a89c1a6074ec00d5c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42497 } }
I20260808 17:41:44.903818 26045 sys_catalog.cc:455] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f441d1764b1e460a89c1a6074ec00d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f441d1764b1e460a89c1a6074ec00d5c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42497 } } }
I20260808 17:41:44.903833 26046 sys_catalog.cc:455] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f441d1764b1e460a89c1a6074ec00d5c. Latest consensus state: current_term: 1 leader_uuid: "f441d1764b1e460a89c1a6074ec00d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f441d1764b1e460a89c1a6074ec00d5c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42497 } } }
I20260808 17:41:44.903936 26045 sys_catalog.cc:458] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:44.903944 26046 sys_catalog.cc:458] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:44.904182 26057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:44.904670 26057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:44.906104 26057 catalog_manager.cc:1347] Generated new cluster ID: 15b232fef41048379be084cf89d7b6c0
I20260808 17:41:44.906173 26057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:41:44.929631 26057 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:44.929816 26057 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:44.938074 26057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f441d1764b1e460a89c1a6074ec00d5c: Generated new TSK 0
I20260808 17:41:44.938282 26057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:41:44.945322 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:42497
--builtin_ntp_servers=127.9.187.212:35749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 17:41:45.026736 26068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:45.026927 26068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:45.026955 26068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:45.028060 26068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:45.028096 26068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:45.028129 26068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:45.029392 26068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:42497
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:45.029606 26068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:45.029865 26068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:45.034451 26075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:45.034483 26076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:45.034473 26079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:45.034644 26068 server_base.cc:1034] running on GCE node
I20260808 17:41:45.034906 26068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:45.035151 26068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:45.036283 26068 hybrid_clock.cc:648] HybridClock initialized: now 1786210905036273 us; error 32 us; skew 500 ppm
I20260808 17:41:45.037401 26068 webserver.cc:460] Webserver started at http://127.9.187.193:34053/ using document root <none> and password file <none>
I20260808 17:41:45.037618 26068 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:45.037667 26068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:45.037854 26068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:45.038900 26068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "40241bf5285848f1a1432876457c4e1f"
format_stamp: "Formatted at 2026-08-08 17:41:45 on dist-test-slave-bqcl"
server_key: "293c6009d8ad499820881d09d770e5ae"
server_key_iv: "d82b51812f0a29bdfdc1fd72c5c070a9"
server_key_version: "encryptionkey@0"
I20260808 17:41:45.039225 26068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "40241bf5285848f1a1432876457c4e1f"
format_stamp: "Formatted at 2026-08-08 17:41:45 on dist-test-slave-bqcl"
server_key: "293c6009d8ad499820881d09d770e5ae"
server_key_iv: "d82b51812f0a29bdfdc1fd72c5c070a9"
server_key_version: "encryptionkey@0"
I20260808 17:41:45.040378 26068 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:41:45.041003 26094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:45.041153 26068 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:45.041227 26068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "40241bf5285848f1a1432876457c4e1f"
format_stamp: "Formatted at 2026-08-08 17:41:45 on dist-test-slave-bqcl"
server_key: "293c6009d8ad499820881d09d770e5ae"
server_key_iv: "d82b51812f0a29bdfdc1fd72c5c070a9"
server_key_version: "encryptionkey@0"
I20260808 17:41:45.041289 26068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:45.044593 26068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:45.044817 26068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:45.044929 26068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:45.045118 26068 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:45.045408 26068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:45.045440 26068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:45.045466 26068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:45.045490 26068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:45.050860 26068 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:38089
I20260808 17:41:45.050899 26284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:38089 every 8 connection(s)
I20260808 17:41:45.051183 26068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:41:45.054044 26039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:45.051827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:54961 (local address 127.9.187.254:42497)
0808 17:41:45.051907 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:45.051909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:45.052140 (+ 231us) server_negotiation.cc:407] Connection header received
0808 17:41:45.052642 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:45.052644 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:45.052651 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:45.052703 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:45.053790 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:45.053793 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:45.053793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:45.053798 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:45.053815 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:45.053820 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:45.053870 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:45.053949 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 17:41:45.053964 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 17:41:45.054257 26289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:45.051806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:42497 (local address 127.9.187.193:54961)
0808 17:41:45.052024 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:45.052058 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:45.052540 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:45.052769 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:45.052773 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:45.052782 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:45.053645 (+ 863us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:45.053645 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:45.053673 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:45.053701 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:45.053873 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:45.053879 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:45.053882 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:45.053959 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 17:41:45.054021 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":89,"threads_started":1}
I20260808 17:41:45.054725 26285 heartbeater.cc:347] Connected to a master server at 127.9.187.254:42497
I20260808 17:41:45.054819 26285 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:45.054957 26285 heartbeater.cc:511] Master 127.9.187.254:42497 requested a full tablet report, sending...
I20260808 17:41:45.055488 25983 ts_manager.cc:194] Registered new tserver with Master: 40241bf5285848f1a1432876457c4e1f (127.9.187.193:38089)
I20260808 17:41:45.060922 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 26068
I20260808 17:41:45.061005 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:45.061177 9967 external_mini_cluster.cc:1428] Setting key 03164a23f28763b20aa23723fd5acf84
I20260808 17:41:45.062036 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:42497
--builtin_ntp_servers=127.9.187.212:35749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 17:41:45.142813 26291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:45.143004 26291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:45.143034 26291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:45.144239 26291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:45.144279 26291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:45.144309 26291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:45.145676 26291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:42497
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:45.145911 26291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:45.146220 26291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:45.150928 26303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:45.150952 26305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:45.150971 26302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:45.151057 26291 server_base.cc:1034] running on GCE node
I20260808 17:41:45.151383 26291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:45.151608 26291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:45.152740 26291 hybrid_clock.cc:648] HybridClock initialized: now 1786210905152726 us; error 31 us; skew 500 ppm
I20260808 17:41:45.153914 26291 webserver.cc:460] Webserver started at http://127.9.187.194:40843/ using document root <none> and password file <none>
I20260808 17:41:45.154176 26291 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:45.154243 26291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:45.154372 26291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:45.155335 26291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "52a7fc019c8849ef86ece4e735ebb1cd"
format_stamp: "Formatted at 2026-08-08 17:41:45 on dist-test-slave-bqcl"
server_key: "af08ab6a9c81a7900bad57a545436413"
server_key_iv: "1329489eeceffb63b2e903697d43ab76"
server_key_version: "encryptionkey@0"
I20260808 17:41:45.155652 26291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "52a7fc019c8849ef86ece4e735ebb1cd"
format_stamp: "Formatted at 2026-08-08 17:41:45 on dist-test-slave-bqcl"
server_key: "af08ab6a9c81a7900bad57a545436413"
server_key_iv: "1329489eeceffb63b2e903697d43ab76"
server_key_version: "encryptionkey@0"
I20260808 17:41:45.156818 26291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:41:45.157503 26313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:45.157655 26291 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:41:45.157735 26291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "52a7fc019c8849ef86ece4e735ebb1cd"
format_stamp: "Formatted at 2026-08-08 17:41:45 on dist-test-slave-bqcl"
server_key: "af08ab6a9c81a7900bad57a545436413"
server_key_iv: "1329489eeceffb63b2e903697d43ab76"
server_key_version: "encryptionkey@0"
I20260808 17:41:45.157800 26291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:45.161005 26291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:45.161252 26291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:45.161370 26291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:45.161549 26291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:45.161821 26291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:45.161854 26291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:45.161878 26291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:45.161895 26291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:45.167695 26291 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:43251
I20260808 17:41:45.167732 26510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:43251 every 8 connection(s)
I20260808 17:41:45.168001 26291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:41:45.170506 26039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:45.168618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:60133 (local address 127.9.187.254:42497)
0808 17:41:45.168689 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:45.168692 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:45.168857 (+ 165us) server_negotiation.cc:407] Connection header received
0808 17:41:45.169253 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:45.169254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:45.169259 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:45.169306 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:45.170326 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:45.170328 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:45.170328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:45.170332 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:45.170348 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:45.170352 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:45.170394 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:45.170441 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 17:41:45.170452 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 17:41:45.170688 26514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:45.168572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:42497 (local address 127.9.187.194:60133)
0808 17:41:45.168741 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:45.168774 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:45.169180 (+ 406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:45.169355 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:45.169358 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:45.169366 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:45.170186 (+ 820us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:45.170187 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:45.170220 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:45.170248 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:45.170398 (+ 150us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:45.170400 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:45.170402 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:41:45.170447 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:41:45.170491 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
I20260808 17:41:45.171134 26511 heartbeater.cc:347] Connected to a master server at 127.9.187.254:42497
I20260808 17:41:45.171211 26511 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:45.171347 26511 heartbeater.cc:511] Master 127.9.187.254:42497 requested a full tablet report, sending...
I20260808 17:41:45.171671 25983 ts_manager.cc:194] Registered new tserver with Master: 52a7fc019c8849ef86ece4e735ebb1cd (127.9.187.194:43251)
I20260808 17:41:45.177207 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 26291
I20260808 17:41:45.177285 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:45.177441 9967 external_mini_cluster.cc:1428] Setting key 85228140b6ab8dba21877d8f6f694e39
I20260808 17:41:45.178324 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:42497
--builtin_ntp_servers=127.9.187.212:35749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 17:41:45.259599 26515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:45.259797 26515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:45.259817 26515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:45.260973 26515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:45.261015 26515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:45.261039 26515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:45.262435 26515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:42497
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:45.262668 26515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:45.262939 26515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:45.267875 26522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:45.267910 26523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:45.268038 26515 server_base.cc:1034] running on GCE node
W20260808 17:41:45.268214 26525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:45.268433 26515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:45.268682 26515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:45.269815 26515 hybrid_clock.cc:648] HybridClock initialized: now 1786210905269805 us; error 31 us; skew 500 ppm
I20260808 17:41:45.271049 26515 webserver.cc:460] Webserver started at http://127.9.187.195:41797/ using document root <none> and password file <none>
I20260808 17:41:45.271267 26515 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:45.271315 26515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:45.271442 26515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:45.272439 26515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "c219a993c75744b3bb0ed17c5a7d27cc"
format_stamp: "Formatted at 2026-08-08 17:41:45 on dist-test-slave-bqcl"
server_key: "eb6a5168b661ca54849261fc4fcce2c7"
server_key_iv: "c26bf0ba34a733b69bfbf555188d4822"
server_key_version: "encryptionkey@0"
I20260808 17:41:45.272794 26515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "c219a993c75744b3bb0ed17c5a7d27cc"
format_stamp: "Formatted at 2026-08-08 17:41:45 on dist-test-slave-bqcl"
server_key: "eb6a5168b661ca54849261fc4fcce2c7"
server_key_iv: "c26bf0ba34a733b69bfbf555188d4822"
server_key_version: "encryptionkey@0"
I20260808 17:41:45.273972 26515 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:41:45.274673 26536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:45.274816 26515 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:45.274896 26515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "c219a993c75744b3bb0ed17c5a7d27cc"
format_stamp: "Formatted at 2026-08-08 17:41:45 on dist-test-slave-bqcl"
server_key: "eb6a5168b661ca54849261fc4fcce2c7"
server_key_iv: "c26bf0ba34a733b69bfbf555188d4822"
server_key_version: "encryptionkey@0"
I20260808 17:41:45.274961 26515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:45.278085 26515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:45.278334 26515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:45.278447 26515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:45.278644 26515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:45.278923 26515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:45.278954 26515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:45.278980 26515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:45.279003 26515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:45.284147 26515 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:39221
I20260808 17:41:45.284210 26721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:39221 every 8 connection(s)
I20260808 17:41:45.284576 26515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:41:45.287318 26039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:45.285202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:41099 (local address 127.9.187.254:42497)
0808 17:41:45.285261 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:45.285263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:45.285461 (+ 198us) server_negotiation.cc:407] Connection header received
0808 17:41:45.285939 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:45.285941 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:45.285948 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:45.286001 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:45.287078 (+ 1077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:45.287079 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:45.287080 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:41:45.287085 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:45.287101 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:41:45.287105 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:45.287154 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:45.287233 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 17:41:45.287247 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:41:45.287487 26725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:45.285173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:42497 (local address 127.9.187.195:41099)
0808 17:41:45.285350 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:45.285380 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:45.285838 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:45.286068 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:45.286072 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:45.286081 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:45.286932 (+ 851us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:41:45.286933 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:45.286959 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:41:45.286986 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:45.287157 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:45.287162 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:45.287165 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:45.287234 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 17:41:45.287291 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
I20260808 17:41:45.287899 26722 heartbeater.cc:347] Connected to a master server at 127.9.187.254:42497
I20260808 17:41:45.287988 26722 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:45.288132 26722 heartbeater.cc:511] Master 127.9.187.254:42497 requested a full tablet report, sending...
I20260808 17:41:45.288468 25983 ts_manager.cc:194] Registered new tserver with Master: c219a993c75744b3bb0ed17c5a7d27cc (127.9.187.195:39221)
I20260808 17:41:45.293330 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 26515
I20260808 17:41:45.293407 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:45.293573 9967 external_mini_cluster.cc:1428] Setting key c1407b429c4be07eaeb84bd665e6c8ed
I20260808 17:41:45.294435 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 17:41:45.296154 26039 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:41:45.295737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42968 (local address 127.9.187.254:42497)
0808 17:41:45.295779 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:45.295781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:45.295883 (+ 102us) server_negotiation.cc:407] Connection header received
0808 17:41:45.295942 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:45.295943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:45.295948 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:45.295983 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:45.296105 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42968: BlockingRecv error: recv got EOF from 127.0.0.1:42968 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:41:45.296208 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 26068
I20260808 17:41:45.316185 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 26291
I20260808 17:41:45.332571 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 26515
I20260808 17:41:45.344534 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 25930
2026-08-08T17:41:45Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (579 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:45 dist-test-slave-bqcl krb5kdc[26736](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:45 dist-test-slave-bqcl krb5kdc[26736](info): set up 2 sockets
Aug 08 17:41:45 dist-test-slave-bqcl krb5kdc[26736](info): commencing operation
krb5kdc: starting...
W20260808 17:41:46.500815 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:46 dist-test-slave-bqcl krb5kdc[26736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:41:46.616647 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:36145
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:42933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:36145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:46.696583 26762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:46.696789 26762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:46.696817 26762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:46.697929 26762 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:41:46.697973 26762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:46.697991 26762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:46.698007 26762 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:41:46.698022 26762 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:41:46.700059 26762 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:36145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:36145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:46.700311 26762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:46.700580 26762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:46.706463 26770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:46.706502 26772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:46.706511 26762 server_base.cc:1034] running on GCE node
W20260808 17:41:46.706475 26768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:46.706902 26762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:46.707185 26762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:46.708323 26762 hybrid_clock.cc:648] HybridClock initialized: now 1786210906708301 us; error 33 us; skew 500 ppm
Aug 08 17:41:46 dist-test-slave-bqcl krb5kdc[26736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210906, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:46.710754 26762 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:41:46.711133 26762 webserver.cc:460] Webserver started at http://127.9.187.254:37267/ using document root <none> and password file <none>
I20260808 17:41:46.711304 26762 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:46.711342 26762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:46.711432 26762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:46.712402 26762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "af90850d9cb74168a95f84e8b73d4c66"
format_stamp: "Formatted at 2026-08-08 17:41:46 on dist-test-slave-bqcl"
server_key: "e728855301d0139f236a00d52e88f2f4"
server_key_iv: "9558e495326d44358f92b8718539483d"
server_key_version: "encryptionkey@0"
I20260808 17:41:46.712697 26762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "af90850d9cb74168a95f84e8b73d4c66"
format_stamp: "Formatted at 2026-08-08 17:41:46 on dist-test-slave-bqcl"
server_key: "e728855301d0139f236a00d52e88f2f4"
server_key_iv: "9558e495326d44358f92b8718539483d"
server_key_version: "encryptionkey@0"
I20260808 17:41:46.713861 26762 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:46.714525 26787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:46.714680 26762 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:46.714766 26762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "af90850d9cb74168a95f84e8b73d4c66"
format_stamp: "Formatted at 2026-08-08 17:41:46 on dist-test-slave-bqcl"
server_key: "e728855301d0139f236a00d52e88f2f4"
server_key_iv: "9558e495326d44358f92b8718539483d"
server_key_version: "encryptionkey@0"
I20260808 17:41:46.714831 26762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:46.728008 26762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:46.730007 26762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:46.730183 26762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:46.733907 26762 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:36145
I20260808 17:41:46.733939 26863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:36145 every 8 connection(s)
I20260808 17:41:46.734268 26762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:41:46.735210 26864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:46.737432 26864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66: Bootstrap starting.
I20260808 17:41:46.737986 26864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:46.738288 26864 log.cc:824] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:46.738940 26864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66: No bootstrap required, opened a new log
I20260808 17:41:46.740482 26864 raft_consensus.cc:348] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af90850d9cb74168a95f84e8b73d4c66" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36145 } }
I20260808 17:41:46.740644 26864 raft_consensus.cc:374] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:46.740680 26864 raft_consensus.cc:729] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af90850d9cb74168a95f84e8b73d4c66, State: Initialized, Role: FOLLOWER
I20260808 17:41:46.740810 26864 consensus_queue.cc:260] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af90850d9cb74168a95f84e8b73d4c66" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36145 } }
I20260808 17:41:46.740890 26864 raft_consensus.cc:388] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:41:46.740888 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 26762
I20260808 17:41:46.740922 26864 raft_consensus.cc:482] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:41:46.740964 26864 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:46.740975 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:41:46.741145 9967 external_mini_cluster.cc:1428] Setting key cd02af792bfa39b509402aff04a2d8de
I20260808 17:41:46.741861 26864 raft_consensus.cc:504] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af90850d9cb74168a95f84e8b73d4c66" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36145 } }
I20260808 17:41:46.741963 26864 leader_election.cc:302] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af90850d9cb74168a95f84e8b73d4c66; no voters:
I20260808 17:41:46.742117 26864 leader_election.cc:288] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:41:46.742163 26877 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:46.742334 26877 raft_consensus.cc:686] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [term 1 LEADER]: Becoming Leader. State: Replica: af90850d9cb74168a95f84e8b73d4c66, State: Running, Role: LEADER
I20260808 17:41:46.742393 26864 sys_catalog.cc:564] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:41:46.743032 26877 consensus_queue.cc:237] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af90850d9cb74168a95f84e8b73d4c66" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36145 } }
I20260808 17:41:46.743551 26879 sys_catalog.cc:455] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af90850d9cb74168a95f84e8b73d4c66. Latest consensus state: current_term: 1 leader_uuid: "af90850d9cb74168a95f84e8b73d4c66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af90850d9cb74168a95f84e8b73d4c66" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36145 } } }
I20260808 17:41:46.743642 26879 sys_catalog.cc:458] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:46.743845 26880 sys_catalog.cc:455] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af90850d9cb74168a95f84e8b73d4c66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af90850d9cb74168a95f84e8b73d4c66" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36145 } } }
I20260808 17:41:46.743903 26880 sys_catalog.cc:458] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66 [sys.catalog]: This master's current role is: LEADER
I20260808 17:41:46.743877 26902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:41:46.744664 26902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:41:46.746223 26902 catalog_manager.cc:1347] Generated new cluster ID: d2117fd38f574ab4b3072ca5e1086d8a
I20260808 17:41:46.746277 26902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:41:46 dist-test-slave-bqcl krb5kdc[26736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:46.751309 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:46.741606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43638 (local address 127.9.187.254:36145)
0808 17:41:46.741782 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:46.741791 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:46.741815 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:41:46.741905 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:46.741910 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:46.741949 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:46.742074 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:46.742809 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:46.744338 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:46.745106 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:46.745675 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:46.745780 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:46.748290 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:46.748294 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:46.748294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:46.748306 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:46.749859 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:46.750193 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:46.750196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:46.750197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:46.750303 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:46.750491 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:46.750492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:46.750492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:46.750712 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:46.750865 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:46.750941 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 17:41:46.751154 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260808 17:41:46.754571 26902 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:41:46.755080 26902 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:41:46.761526 26902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66: Generated new TSK 0
I20260808 17:41:46.761682 26902 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:41:46.792757 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36145
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:42933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:46.873836 26913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:46.874056 26913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:46.874089 26913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:46.875236 26913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:46.875281 26913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:46.875316 26913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:41:46.876772 26913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:46.877012 26913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:46.877238 26913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:46.882035 26921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:46.882035 26923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:46.882012 26925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:46.882222 26913 server_base.cc:1034] running on GCE node
I20260808 17:41:46.882484 26913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:46.882741 26913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:46.883888 26913 hybrid_clock.cc:648] HybridClock initialized: now 1786210906883852 us; error 49 us; skew 500 ppm
Aug 08 17:41:46 dist-test-slave-bqcl krb5kdc[26736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210906, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:46.886389 26913 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:41:46.886818 26913 webserver.cc:460] Webserver started at http://127.9.187.193:33697/ using document root <none> and password file <none>
I20260808 17:41:46.887015 26913 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:46.887056 26913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:46.887143 26913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:46.888123 26913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "496be89516c442dc9833a51232bb8900"
format_stamp: "Formatted at 2026-08-08 17:41:46 on dist-test-slave-bqcl"
server_key: "da6fe2de1c7fbe5a4016d0757ab2710c"
server_key_iv: "74bb2a80f0229f12aecf0081cf838f62"
server_key_version: "encryptionkey@0"
I20260808 17:41:46.888428 26913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "496be89516c442dc9833a51232bb8900"
format_stamp: "Formatted at 2026-08-08 17:41:46 on dist-test-slave-bqcl"
server_key: "da6fe2de1c7fbe5a4016d0757ab2710c"
server_key_iv: "74bb2a80f0229f12aecf0081cf838f62"
server_key_version: "encryptionkey@0"
I20260808 17:41:46.889597 26913 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:41:46.890339 26938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:46.890520 26913 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:41:46.890609 26913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "496be89516c442dc9833a51232bb8900"
format_stamp: "Formatted at 2026-08-08 17:41:46 on dist-test-slave-bqcl"
server_key: "da6fe2de1c7fbe5a4016d0757ab2710c"
server_key_iv: "74bb2a80f0229f12aecf0081cf838f62"
server_key_version: "encryptionkey@0"
I20260808 17:41:46.890684 26913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:46.918146 26913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:46.919977 26913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:46.920084 26913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:46.920274 26913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:46.920528 26913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:46.920557 26913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:46.920584 26913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:46.920598 26913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:46.925969 26913 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:44395
I20260808 17:41:46.926015 27125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:44395 every 8 connection(s)
I20260808 17:41:46.926329 26913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:41:46.928186 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 26913
I20260808 17:41:46.928280 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:41:46.928469 9967 external_mini_cluster.cc:1428] Setting key f045c8f4365594706a3cfa5f50985b26
Aug 08 17:41:46 dist-test-slave-bqcl krb5kdc[26736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210906, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:46.935953 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:46.926998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:54545 (local address 127.9.187.254:36145)
0808 17:41:46.927051 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:46.927053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:46.927258 (+ 205us) server_negotiation.cc:407] Connection header received
0808 17:41:46.927757 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:46.927758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:46.927773 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:46.927827 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:46.928850 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:46.929499 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:46.930520 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:46.930809 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:46.930876 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:46.933040 (+ 2164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:46.933042 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:46.933042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:46.933052 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:46.934608 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:46.935023 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:46.935024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:46.935024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:46.935093 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:46.935303 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:46.935304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:46.935304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:46.935444 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:46.935517 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:46.935778 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 17:41:46.935864 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:41:46.936004 27128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:46.926977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:36145 (local address 127.9.187.193:54545)
0808 17:41:46.927145 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:46.927181 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:46.927663 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:46.927909 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:46.927913 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:46.928504 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:46.928776 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:46.928783 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:46.929588 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:46.929589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:46.930444 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:46.930447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:46.930909 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:46.930910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:46.931052 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:46.931493 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:46.931503 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:46.932955 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:46.934700 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:46.934707 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:46.934713 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:46.934950 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:46.935154 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:46.935155 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:46.935155 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:46.935247 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:46.935512 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:46.935518 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:46.935649 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 17:41:46.935728 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 17:41:46.935843 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260808 17:41:46.936519 27126 heartbeater.cc:347] Connected to a master server at 127.9.187.254:36145
I20260808 17:41:46.936610 27126 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:46.936780 27126 heartbeater.cc:511] Master 127.9.187.254:36145 requested a full tablet report, sending...
I20260808 17:41:46.937282 26817 ts_manager.cc:194] Registered new tserver with Master: 496be89516c442dc9833a51232bb8900 (127.9.187.193:44395)
I20260808 17:41:46.937857 26817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:54545
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:41:46.954627 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36145
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:42933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:47.034637 27131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:47.034827 27131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:47.034858 27131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:47.035960 27131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:47.036002 27131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:47.036036 27131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:41:47.037441 27131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:47.037673 27131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:47.037878 27131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:47.042533 27138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:47.042502 27140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:47.042696 27131 server_base.cc:1034] running on GCE node
W20260808 17:41:47.042505 27143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:47.042964 27131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:47.043233 27131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:47.044364 27131 hybrid_clock.cc:648] HybridClock initialized: now 1786210907044353 us; error 24 us; skew 500 ppm
Aug 08 17:41:47 dist-test-slave-bqcl krb5kdc[26736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210907, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:47.046880 27131 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:41:47.047273 27131 webserver.cc:460] Webserver started at http://127.9.187.194:37567/ using document root <none> and password file <none>
I20260808 17:41:47.047488 27131 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:47.047536 27131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:47.047662 27131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:47.048621 27131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "0c8cfb1a2a3943d3924434b0b14c0785"
format_stamp: "Formatted at 2026-08-08 17:41:47 on dist-test-slave-bqcl"
server_key: "ee33fd24b45a097768a2eb28ea913b2a"
server_key_iv: "9b50343e984d55d0fd010c2c2543f3c4"
server_key_version: "encryptionkey@0"
I20260808 17:41:47.048959 27131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "0c8cfb1a2a3943d3924434b0b14c0785"
format_stamp: "Formatted at 2026-08-08 17:41:47 on dist-test-slave-bqcl"
server_key: "ee33fd24b45a097768a2eb28ea913b2a"
server_key_iv: "9b50343e984d55d0fd010c2c2543f3c4"
server_key_version: "encryptionkey@0"
I20260808 17:41:47.050195 27131 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:41:47.050953 27153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:47.051111 27131 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:41:47.051195 27131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "0c8cfb1a2a3943d3924434b0b14c0785"
format_stamp: "Formatted at 2026-08-08 17:41:47 on dist-test-slave-bqcl"
server_key: "ee33fd24b45a097768a2eb28ea913b2a"
server_key_iv: "9b50343e984d55d0fd010c2c2543f3c4"
server_key_version: "encryptionkey@0"
I20260808 17:41:47.051261 27131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:47.065081 27131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:47.066864 27131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:47.066993 27131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:47.067183 27131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:47.067476 27131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:47.067513 27131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:47.067540 27131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:47.067564 27131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:47.072914 27131 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:34407
I20260808 17:41:47.072971 27343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:34407 every 8 connection(s)
I20260808 17:41:47.073243 27131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:41:47.079471 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 27131
I20260808 17:41:47.079589 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:41:47.079800 9967 external_mini_cluster.cc:1428] Setting key c419d70e9e70235d4288c102c0bb1100
Aug 08 17:41:47 dist-test-slave-bqcl krb5kdc[26736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210907, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:47.086316 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.073912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:45189 (local address 127.9.187.254:36145)
0808 17:41:47.073973 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:47.073975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:47.074144 (+ 169us) server_negotiation.cc:407] Connection header received
0808 17:41:47.074607 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:47.074608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:47.074618 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:47.074672 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:47.075519 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.076017 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.078152 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.078484 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.078532 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.083089 (+ 4557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:47.083091 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:47.083091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:47.083100 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:47.084691 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:47.085191 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:47.085192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:47.085193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:47.085271 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:47.085562 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:47.085563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:47.085563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:47.085698 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:47.085762 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:47.086099 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 17:41:47.086215 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 17:41:47.086512 27347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.073866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:36145 (local address 127.9.187.194:45189)
0808 17:41:47.074011 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:47.074050 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:47.074512 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:47.074723 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:47.074726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:47.075261 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:47.075439 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.075444 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.076110 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.076110 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.078017 (+ 1907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.078021 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.078632 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.078634 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.078785 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.081355 (+ 2570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:47.081364 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:47.082969 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:47.084791 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:47.084800 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:47.084802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:47.085107 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:47.085343 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:47.085343 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:47.085344 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:47.085486 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:47.085773 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:47.085780 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:47.085954 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 17:41:47.086076 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 17:41:47.086280 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":77,"threads_started":1}
I20260808 17:41:47.087013 27345 heartbeater.cc:347] Connected to a master server at 127.9.187.254:36145
I20260808 17:41:47.087157 27345 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:47.087399 27345 heartbeater.cc:511] Master 127.9.187.254:36145 requested a full tablet report, sending...
I20260808 17:41:47.087860 26817 ts_manager.cc:194] Registered new tserver with Master: 0c8cfb1a2a3943d3924434b0b14c0785 (127.9.187.194:34407)
I20260808 17:41:47.088358 26817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:45189
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:41:47.105825 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36145
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:42933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:41:47.186779 27353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:41:47.186985 27353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:41:47.187016 27353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:41:47.188130 27353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:41:47.188172 27353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:41:47.188207 27353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:41:47.189649 27353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:41:47.189889 27353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:41:47.190100 27353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:41:47.194947 27359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:47.194950 27363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:41:47.195035 27361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:41:47.195245 27353 server_base.cc:1034] running on GCE node
I20260808 17:41:47.195428 27353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:41:47.195626 27353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:41:47.196756 27353 hybrid_clock.cc:648] HybridClock initialized: now 1786210907196743 us; error 30 us; skew 500 ppm
Aug 08 17:41:47 dist-test-slave-bqcl krb5kdc[26736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210907, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:41:47.199244 27353 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:41:47.199663 27353 webserver.cc:460] Webserver started at http://127.9.187.195:34769/ using document root <none> and password file <none>
I20260808 17:41:47.199872 27353 fs_manager.cc:359] Metadata directory not provided
I20260808 17:41:47.199914 27353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:41:47.200042 27353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:41:47.201083 27353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "53f03dab120748758d2e9ecdaf57ba6e"
format_stamp: "Formatted at 2026-08-08 17:41:47 on dist-test-slave-bqcl"
server_key: "5cecece1bffd69f1446957288b45287c"
server_key_iv: "53aa70f855ef7aa7d688d727774a17e4"
server_key_version: "encryptionkey@0"
I20260808 17:41:47.201418 27353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "53f03dab120748758d2e9ecdaf57ba6e"
format_stamp: "Formatted at 2026-08-08 17:41:47 on dist-test-slave-bqcl"
server_key: "5cecece1bffd69f1446957288b45287c"
server_key_iv: "53aa70f855ef7aa7d688d727774a17e4"
server_key_version: "encryptionkey@0"
I20260808 17:41:47.202733 27353 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:41:47.203388 27373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:47.203555 27353 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:47.203644 27353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "53f03dab120748758d2e9ecdaf57ba6e"
format_stamp: "Formatted at 2026-08-08 17:41:47 on dist-test-slave-bqcl"
server_key: "5cecece1bffd69f1446957288b45287c"
server_key_iv: "53aa70f855ef7aa7d688d727774a17e4"
server_key_version: "encryptionkey@0"
I20260808 17:41:47.203696 27353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:41:47.212132 27353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:41:47.213717 27353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:41:47.213820 27353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:41:47.213984 27353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:41:47.214253 27353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:41:47.214288 27353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:47.214308 27353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:41:47.214327 27353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:41:47.219801 27353 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:39117
I20260808 17:41:47.219866 27551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:39117 every 8 connection(s)
I20260808 17:41:47.220129 27353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:41:47.220671 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 27353
I20260808 17:41:47.220785 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:41:47.220969 9967 external_mini_cluster.cc:1428] Setting key 76c6c6cb95d743db6e437d02a16f0256
Aug 08 17:41:47 dist-test-slave-bqcl krb5kdc[26736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210907, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:41:47.228760 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.220789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:57631 (local address 127.9.187.254:36145)
0808 17:41:47.220854 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:47.220856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:47.221282 (+ 426us) server_negotiation.cc:407] Connection header received
0808 17:41:47.221883 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:47.221884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:47.221893 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:47.221936 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:47.222915 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.223405 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.224383 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.224569 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.224614 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.226542 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:47.226544 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:47.226544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:47.226551 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:47.227790 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:47.228084 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:47.228085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:47.228085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:47.228129 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:47.228298 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:47.228298 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:47.228298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:47.228388 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:47.228434 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:47.228641 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 17:41:47.228697 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 17:41:47.228943 27557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.220748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:36145 (local address 127.9.187.195:57631)
0808 17:41:47.221154 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:47.221191 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:47.221789 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:47.221992 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:47.221995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:47.222644 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:41:47.222838 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.222843 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.223479 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.223480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.224320 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.224323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.224625 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.224625 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.224722 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.225158 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:41:47.225166 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:41:47.226463 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:41:47.227847 (+ 1384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:47.227850 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:47.227851 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:47.228034 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:47.228171 (+ 137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:41:47.228171 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:41:47.228172 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:41:47.228257 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:41:47.228432 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:41:47.228435 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:41:47.228544 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 17:41:47.228620 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 17:41:47.228742 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":73,"threads_started":1}
I20260808 17:41:47.229355 27552 heartbeater.cc:347] Connected to a master server at 127.9.187.254:36145
I20260808 17:41:47.229441 27552 heartbeater.cc:464] Registering TS with master...
I20260808 17:41:47.229604 27552 heartbeater.cc:511] Master 127.9.187.254:36145 requested a full tablet report, sending...
I20260808 17:41:47.229951 26817 ts_manager.cc:194] Registered new tserver with Master: 53f03dab120748758d2e9ecdaf57ba6e (127.9.187.195:39117)
I20260808 17:41:47.230350 26817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:57631
I20260808 17:41:47.232400 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:41:47.238610 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.233618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43652 (local address 127.9.187.254:36145)
0808 17:41:47.233668 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:47.233671 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:47.233747 (+ 76us) server_negotiation.cc:407] Connection header received
0808 17:41:47.233788 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:47.233788 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:47.233796 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:47.233836 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:41:47.234396 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.234844 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.235500 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.235676 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.235718 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.236656 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:41:47.236657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:41:47.236657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:41:47.236662 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:41:47.237773 (+ 1111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:47.238008 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:47.238008 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:47.238009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:47.238050 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:41:47.238194 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:41:47.238195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:41:47.238195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:41:47.238312 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:41:47.238381 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:47.238469 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 17:41:47.238520 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:41:47.240068 26817 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43652:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:41:47.241544 26817 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:41:47.247392 27573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.243537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:39117 (local address 127.0.0.1:36882)
0808 17:41:47.243858 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:47.243896 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:47.243964 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:47.244157 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:47.244160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:47.244162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:47.244226 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.244229 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.245270 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.245272 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.246258 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.246261 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.247109 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.247111 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.247199 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.247212 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 17:41:47.247273 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 17:41:47.247325 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":83,"threads_started":1}
I20260808 17:41:47.247402 27571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.243609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36882 (local address 127.9.187.195:39117)
0808 17:41:47.243864 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:47.243868 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:47.243959 (+ 91us) server_negotiation.cc:407] Connection header received
0808 17:41:47.244031 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:47.244033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:47.244048 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:47.244297 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:47.244341 (+ 44us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.245176 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.246349 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.247045 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.247101 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.247157 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:47.247293 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 17:41:47.247330 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":69,"threads_started":1}
I20260808 17:41:47.247812 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.243762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:34407 (local address 127.0.0.1:51440)
0808 17:41:47.244205 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:47.244214 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:47.244258 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:47.244423 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:47.244424 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:47.244426 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:47.244469 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.244471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.245733 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.245734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.246699 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.246702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.247575 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.247576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.247633 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.247637 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:47.247693 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:41:47.247730 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":28,"thread_start_us":41,"threads_started":1}
I20260808 17:41:47.247860 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.243843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51440 (local address 127.9.187.194:34407)
0808 17:41:47.243995 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:47.244000 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:47.244263 (+ 263us) server_negotiation.cc:407] Connection header received
0808 17:41:47.244320 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:47.244323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:47.244340 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:47.244423 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:47.244536 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.245616 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.246781 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.247410 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.247479 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.247538 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:47.247726 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 17:41:47.247774 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260808 17:41:47.248219 27569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.243545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:44395 (local address 127.0.0.1:36256)
0808 17:41:47.244063 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:47.244094 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:47.244133 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:47.244577 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:47.244578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:47.244579 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:47.244607 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.244608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.245816 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.245817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.246907 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.246910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.248017 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.248017 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.248076 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.248079 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:47.248119 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 17:41:47.248155 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":70,"threads_started":1}
I20260808 17:41:47.248422 27572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.243637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36256 (local address 127.9.187.193:44395)
0808 17:41:47.244125 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:47.244129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:47.244141 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:41:47.244469 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:47.244479 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:47.244501 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:47.244582 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:47.244669 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.245727 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.246994 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.247849 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.248019 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.248102 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:47.248129 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 17:41:47.248165 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":101,"threads_started":1}
I20260808 17:41:47.248423 27452 tablet_service.cc:1467] Processing CreateTablet for tablet fad6ff22eb9a41f7a10d5e484e1ef1eb (DEFAULT_TABLE table=test-table [id=5376aa14c7fd4957ba06a2729fbdb037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:47.248418 27227 tablet_service.cc:1467] Processing CreateTablet for tablet fad6ff22eb9a41f7a10d5e484e1ef1eb (DEFAULT_TABLE table=test-table [id=5376aa14c7fd4957ba06a2729fbdb037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:47.248773 27227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fad6ff22eb9a41f7a10d5e484e1ef1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:47.248773 27452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fad6ff22eb9a41f7a10d5e484e1ef1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:47.249150 27010 tablet_service.cc:1467] Processing CreateTablet for tablet fad6ff22eb9a41f7a10d5e484e1ef1eb (DEFAULT_TABLE table=test-table [id=5376aa14c7fd4957ba06a2729fbdb037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:41:47.249436 27010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fad6ff22eb9a41f7a10d5e484e1ef1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:41:47.252272 27577 tablet_bootstrap.cc:492] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900: Bootstrap starting.
I20260808 17:41:47.252868 27575 tablet_bootstrap.cc:492] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e: Bootstrap starting.
I20260808 17:41:47.253300 27577 tablet_bootstrap.cc:654] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:47.253556 27575 tablet_bootstrap.cc:654] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:47.253614 27577 log.cc:824] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:47.254217 27575 log.cc:824] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:47.254563 27576 tablet_bootstrap.cc:492] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: Bootstrap starting.
I20260808 17:41:47.254894 27577 tablet_bootstrap.cc:492] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900: No bootstrap required, opened a new log
I20260808 17:41:47.254954 27577 ts_tablet_manager.cc:1397] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 17:41:47.255160 27576 tablet_bootstrap.cc:654] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: Neither blocks nor log segments found. Creating new log.
I20260808 17:41:47.255620 27576 log.cc:824] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: Log is configured to *not* fsync() on all Append() calls
I20260808 17:41:47.256273 27576 tablet_bootstrap.cc:492] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: No bootstrap required, opened a new log
I20260808 17:41:47.256347 27576 ts_tablet_manager.cc:1397] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:41:47.256495 27577 raft_consensus.cc:348] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f03dab120748758d2e9ecdaf57ba6e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 39117 } } peers { permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 } } peers { permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 } }
I20260808 17:41:47.256626 27577 raft_consensus.cc:374] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:47.256661 27577 raft_consensus.cc:729] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 496be89516c442dc9833a51232bb8900, State: Initialized, Role: FOLLOWER
I20260808 17:41:47.256772 27577 consensus_queue.cc:260] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f03dab120748758d2e9ecdaf57ba6e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 39117 } } peers { permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 } } peers { permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 } }
I20260808 17:41:47.257045 27577 ts_tablet_manager.cc:1428] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:41:47.257066 27126 heartbeater.cc:503] Master 127.9.187.254:36145 was elected leader, sending a full tablet report...
I20260808 17:41:47.257483 27575 tablet_bootstrap.cc:492] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e: No bootstrap required, opened a new log
I20260808 17:41:47.257539 27575 ts_tablet_manager.cc:1397] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260808 17:41:47.258937 27575 raft_consensus.cc:348] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f03dab120748758d2e9ecdaf57ba6e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 39117 } } peers { permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 } } peers { permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 } }
I20260808 17:41:47.259060 27575 raft_consensus.cc:374] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:47.259081 27575 raft_consensus.cc:729] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f03dab120748758d2e9ecdaf57ba6e, State: Initialized, Role: FOLLOWER
I20260808 17:41:47.259187 27575 consensus_queue.cc:260] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f03dab120748758d2e9ecdaf57ba6e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 39117 } } peers { permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 } } peers { permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 } }
I20260808 17:41:47.259423 27575 ts_tablet_manager.cc:1428] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:41:47.259469 27552 heartbeater.cc:503] Master 127.9.187.254:36145 was elected leader, sending a full tablet report...
I20260808 17:41:47.260386 27576 raft_consensus.cc:348] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f03dab120748758d2e9ecdaf57ba6e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 39117 } } peers { permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 } } peers { permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 } }
I20260808 17:41:47.260537 27576 raft_consensus.cc:374] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:41:47.260591 27576 raft_consensus.cc:729] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8cfb1a2a3943d3924434b0b14c0785, State: Initialized, Role: FOLLOWER
I20260808 17:41:47.260705 27576 consensus_queue.cc:260] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f03dab120748758d2e9ecdaf57ba6e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 39117 } } peers { permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 } } peers { permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 } }
I20260808 17:41:47.260942 27576 ts_tablet_manager.cc:1428] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260808 17:41:47.261003 27345 heartbeater.cc:503] Master 127.9.187.254:36145 was elected leader, sending a full tablet report...
I20260808 17:41:47.293675 27587 raft_consensus.cc:482] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:47.293784 27587 raft_consensus.cc:504] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f03dab120748758d2e9ecdaf57ba6e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 39117 } } peers { permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 } } peers { permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 } }
I20260808 17:41:47.294090 27587 leader_election.cc:288] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 496be89516c442dc9833a51232bb8900 (127.9.187.193:44395), 0c8cfb1a2a3943d3924434b0b14c0785 (127.9.187.194:34407)
I20260808 17:41:47.296671 27586 raft_consensus.cc:482] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:41:47.296787 27586 raft_consensus.cc:504] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f03dab120748758d2e9ecdaf57ba6e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 39117 } } peers { permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 } } peers { permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 } }
I20260808 17:41:47.296917 27557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.294255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:44395 (local address 127.9.187.195:33299)
0808 17:41:47.294318 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:47.294329 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:47.294370 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:47.294508 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:47.294509 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:47.294510 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:47.294577 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.294580 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.295258 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.295258 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.296089 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.296092 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.296681 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.296683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.296760 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.296763 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:47.296813 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:41:47.296849 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":51}
I20260808 17:41:47.297009 27590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.294292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:34407 (local address 127.9.187.195:49017)
0808 17:41:47.294514 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:47.294522 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:47.294573 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:47.294676 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:47.294677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:47.294678 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:47.294742 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.294743 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.295328 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.295328 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.296104 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.296106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.296696 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.296697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.296784 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.296788 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:41:47.296862 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 17:41:47.296900 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":84,"threads_started":1}
I20260808 17:41:47.297047 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.294342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:49017 (local address 127.9.187.194:34407)
0808 17:41:47.294452 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:47.294454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:47.294567 (+ 113us) server_negotiation.cc:407] Connection header received
0808 17:41:47.294614 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:47.294615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:47.294624 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:47.294674 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:47.294796 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.295253 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.296189 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.296620 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.296684 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.296693 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:47.296923 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 17:41:47.296969 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 17:41:47.297101 27572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.294337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:33299 (local address 127.9.187.193:44395)
0808 17:41:47.294391 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:47.294393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:47.294403 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:41:47.294432 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:47.294433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:47.294445 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:47.294500 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:47.294653 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.295179 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.296177 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.296572 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.296637 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.296647 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:47.297009 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 17:41:47.297049 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:41:47.297149 27586 leader_election.cc:288] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53f03dab120748758d2e9ecdaf57ba6e (127.9.187.195:39117), 0c8cfb1a2a3943d3924434b0b14c0785 (127.9.187.194:34407)
I20260808 17:41:47.297355 27269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad6ff22eb9a41f7a10d5e484e1ef1eb" candidate_uuid: "53f03dab120748758d2e9ecdaf57ba6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" is_pre_election: true
I20260808 17:41:47.297439 27053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad6ff22eb9a41f7a10d5e484e1ef1eb" candidate_uuid: "53f03dab120748758d2e9ecdaf57ba6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "496be89516c442dc9833a51232bb8900" is_pre_election: true
I20260808 17:41:47.297482 27269 raft_consensus.cc:2454] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53f03dab120748758d2e9ecdaf57ba6e in term 0.
I20260808 17:41:47.297537 27053 raft_consensus.cc:2454] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53f03dab120748758d2e9ecdaf57ba6e in term 0.
I20260808 17:41:47.297715 27375 leader_election.cc:302] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8cfb1a2a3943d3924434b0b14c0785, 53f03dab120748758d2e9ecdaf57ba6e; no voters:
I20260808 17:41:47.298213 27587 raft_consensus.cc:2781] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:41:47.298278 27587 raft_consensus.cc:482] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:41:47.298305 27587 raft_consensus.cc:3037] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:47.299156 27587 raft_consensus.cc:504] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f03dab120748758d2e9ecdaf57ba6e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 39117 } } peers { permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 } } peers { permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 } }
I20260808 17:41:47.299405 27053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad6ff22eb9a41f7a10d5e484e1ef1eb" candidate_uuid: "53f03dab120748758d2e9ecdaf57ba6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "496be89516c442dc9833a51232bb8900"
I20260808 17:41:47.299480 27053 raft_consensus.cc:3037] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:47.299500 27587 leader_election.cc:288] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [CANDIDATE]: Term 1 election: Requested vote from peers 496be89516c442dc9833a51232bb8900 (127.9.187.193:44395), 0c8cfb1a2a3943d3924434b0b14c0785 (127.9.187.194:34407)
I20260808 17:41:47.299604 27269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad6ff22eb9a41f7a10d5e484e1ef1eb" candidate_uuid: "53f03dab120748758d2e9ecdaf57ba6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8cfb1a2a3943d3924434b0b14c0785"
I20260808 17:41:47.299665 27269 raft_consensus.cc:3037] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:41:47.300287 27053 raft_consensus.cc:2454] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f03dab120748758d2e9ecdaf57ba6e in term 1.
I20260808 17:41:47.300458 27379 leader_election.cc:302] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 496be89516c442dc9833a51232bb8900, 53f03dab120748758d2e9ecdaf57ba6e; no voters:
I20260808 17:41:47.300472 27269 raft_consensus.cc:2454] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f03dab120748758d2e9ecdaf57ba6e in term 1.
I20260808 17:41:47.300628 27587 raft_consensus.cc:2781] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:41:47.300812 27587 raft_consensus.cc:686] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 1 LEADER]: Becoming Leader. State: Replica: 53f03dab120748758d2e9ecdaf57ba6e, State: Running, Role: LEADER
I20260808 17:41:47.300935 27128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.297384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:39117 (local address 127.9.187.193:43627)
0808 17:41:47.297674 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:47.297683 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:47.297717 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:47.297951 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:47.297952 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:47.297953 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:47.297995 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.297996 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.298877 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.298878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.299992 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.299995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.300652 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.300653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.300767 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.300772 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:41:47.300822 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:41:47.300876 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":35}
I20260808 17:41:47.300959 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.297635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:53919 (local address 127.9.187.194:34407)
0808 17:41:47.298080 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:47.298081 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:47.298086 (+ 5us) server_negotiation.cc:407] Connection header received
0808 17:41:47.298101 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:47.298102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:47.298108 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:47.298170 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:47.298326 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.298927 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.300174 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.300646 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.300685 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.300692 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:47.300876 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 17:41:47.300909 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427}
I20260808 17:41:47.300943 27587 consensus_queue.cc:237] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f03dab120748758d2e9ecdaf57ba6e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 39117 } } peers { permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 } } peers { permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 } }
I20260808 17:41:47.301139 27591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.297490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:34407 (local address 127.9.187.193:53919)
0808 17:41:47.297755 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:47.297763 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:41:47.297803 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:41:47.298186 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:41:47.298187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:41:47.298188 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:41:47.298246 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.298247 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.299030 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.299031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.300079 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:41:47.300081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.300717 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.300718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:41:47.300792 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.300795 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:41:47.301021 (+ 226us) client_negotiation.cc:240] Negotiation successful
0808 17:41:47.301064 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":106,"threads_started":1}
I20260808 17:41:47.301179 27571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.297640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:43627 (local address 127.9.187.195:39117)
0808 17:41:47.297780 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:47.297782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:47.297788 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:41:47.297805 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:47.297806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:47.297814 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:47.297855 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:41:47.298063 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.298782 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.300091 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.300553 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.300613 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.300620 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:47.301094 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 17:41:47.301129 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260808 17:41:47.301350 27478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad6ff22eb9a41f7a10d5e484e1ef1eb" candidate_uuid: "496be89516c442dc9833a51232bb8900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f03dab120748758d2e9ecdaf57ba6e" is_pre_election: true
I20260808 17:41:47.301384 27269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad6ff22eb9a41f7a10d5e484e1ef1eb" candidate_uuid: "496be89516c442dc9833a51232bb8900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" is_pre_election: true
I20260808 17:41:47.301462 27269 raft_consensus.cc:2379] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 496be89516c442dc9833a51232bb8900 in current term 1: Already voted for candidate 53f03dab120748758d2e9ecdaf57ba6e in this term.
I20260808 17:41:47.301676 26939 leader_election.cc:302] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 496be89516c442dc9833a51232bb8900; no voters: 0c8cfb1a2a3943d3924434b0b14c0785, 53f03dab120748758d2e9ecdaf57ba6e
I20260808 17:41:47.301811 27586 raft_consensus.cc:2726] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 17:41:47.301996 26817 catalog_manager.cc:5495] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 53f03dab120748758d2e9ecdaf57ba6e (127.9.187.195). New cstate: current_term: 1 leader_uuid: "53f03dab120748758d2e9ecdaf57ba6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f03dab120748758d2e9ecdaf57ba6e" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 } health_report { overall_health: UNKNOWN } } }
I20260808 17:41:47.320448 27571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.318164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36886 (local address 127.9.187.195:39117)
0808 17:41:47.318212 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:41:47.318213 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:41:47.318224 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:41:47.318309 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:41:47.318309 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:41:47.318328 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:41:47.318391 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:41:47.318518 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.318963 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.319681 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:41:47.319902 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:41:47.319960 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:41:47.320119 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:41:47.320225 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:41:47.320304 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 17:41:47.320342 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 17:41:47.320360 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:41:47.322052 27269 raft_consensus.cc:1261] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785 [term 1 FOLLOWER]: Refusing update from remote peer 53f03dab120748758d2e9ecdaf57ba6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:47.322078 27053 raft_consensus.cc:1261] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 1 FOLLOWER]: Refusing update from remote peer 53f03dab120748758d2e9ecdaf57ba6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:41:47.322410 27592 consensus_queue.cc:1035] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8cfb1a2a3943d3924434b0b14c0785" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:41:47.322535 27587 consensus_queue.cc:1035] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "496be89516c442dc9833a51232bb8900" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 17:41:47.323734 27346 tablet.cc:2369] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:41:47.325078 27597 mvcc.cc:205] Tried to move back new op lower bound from 7316319876388880384 to 7316319876305506304. Current Snapshot: MvccSnapshot[applied={T|T < 7316319876388880384}]
I20260808 17:41:47.325222 27599 mvcc.cc:205] Tried to move back new op lower bound from 7316319876388880384 to 7316319876305506304. Current Snapshot: MvccSnapshot[applied={T|T < 7316319876388880384}]
I20260808 17:41:47.325585 27596 mvcc.cc:205] Tried to move back new op lower bound from 7316319876388880384 to 7316319876305506304. Current Snapshot: MvccSnapshot[applied={T|T < 7316319876388880384 or (T in {7316319876388880384})}]
I20260808 17:41:47.327165 26817 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43652:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:47.327252 26817 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43652:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:41:47.327940 26817 catalog_manager.cc:5782] T 00000000000000000000000000000000 P af90850d9cb74168a95f84e8b73d4c66: Sending DeleteTablet for 3 replicas of tablet fad6ff22eb9a41f7a10d5e484e1ef1eb
I20260808 17:41:47.328307 27010 tablet_service.cc:1514] Processing DeleteTablet for tablet fad6ff22eb9a41f7a10d5e484e1ef1eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:47 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:36256
I20260808 17:41:47.328331 27452 tablet_service.cc:1514] Processing DeleteTablet for tablet fad6ff22eb9a41f7a10d5e484e1ef1eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:47 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:36882
I20260808 17:41:47.328531 27614 tablet_replica.cc:330] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900: stopping tablet replica
I20260808 17:41:47.328545 27227 tablet_service.cc:1514] Processing DeleteTablet for tablet fad6ff22eb9a41f7a10d5e484e1ef1eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:41:47 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:51440
I20260808 17:41:47.328677 27614 raft_consensus.cc:2229] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:47.328750 27615 tablet_replica.cc:330] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: stopping tablet replica
I20260808 17:41:47.328853 27615 raft_consensus.cc:2229] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:41:47.328933 27614 raft_consensus.cc:2258] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 496be89516c442dc9833a51232bb8900 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:47.328958 27615 raft_consensus.cc:2258] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:47.328999 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 26913
I20260808 17:41:47.329169 27613 tablet_replica.cc:330] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e: stopping tablet replica
I20260808 17:41:47.329296 27613 raft_consensus.cc:2229] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:41:47.329444 27613 raft_consensus.cc:2258] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:41:47.345031 27613 ts_tablet_manager.cc:1905] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:47.346520 27613 ts_tablet_manager.cc:1918] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:47.346590 27613 log.cc:1196] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/fad6ff22eb9a41f7a10d5e484e1ef1eb
I20260808 17:41:47.346858 27613 ts_tablet_manager.cc:1939] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 53f03dab120748758d2e9ecdaf57ba6e: Deleting consensus metadata
I20260808 17:41:47.347092 27615 ts_tablet_manager.cc:1905] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:41:47.347294 26794 catalog_manager.cc:4841] TS 53f03dab120748758d2e9ecdaf57ba6e (127.9.187.195:39117): tablet fad6ff22eb9a41f7a10d5e484e1ef1eb (table test-table [id=5376aa14c7fd4957ba06a2729fbdb037]) successfully deleted
I20260808 17:41:47.348666 27615 ts_tablet_manager.cc:1918] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:41:47.348748 27615 log.cc:1196] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/fad6ff22eb9a41f7a10d5e484e1ef1eb
I20260808 17:41:47.349023 27615 ts_tablet_manager.cc:1939] T fad6ff22eb9a41f7a10d5e484e1ef1eb P 0c8cfb1a2a3943d3924434b0b14c0785: Deleting consensus metadata
I20260808 17:41:47.349463 26794 catalog_manager.cc:4841] TS 0c8cfb1a2a3943d3924434b0b14c0785 (127.9.187.194:34407): tablet fad6ff22eb9a41f7a10d5e484e1ef1eb (table test-table [id=5376aa14c7fd4957ba06a2729fbdb037]) successfully deleted
W20260808 17:41:47.351462 26797 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:44395 (error 108)
I20260808 17:41:47.351789 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 27131
I20260808 17:41:47.351964 27569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:41:47.351844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:44395 (local address 127.0.0.1:36264)
0808 17:41:47.351895 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 17:41:47.351931 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:44395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 17:41:47.353832 26797 catalog_manager.cc:4584] TS 496be89516c442dc9833a51232bb8900 (127.9.187.193:44395): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fad6ff22eb9a41f7a10d5e484e1ef1eb: Network error: Client connection negotiation failed: client connection to 127.9.187.193:44395: connect: Connection refused (error 111)
I20260808 17:41:47.370029 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 27353
I20260808 17:41:47.380805 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 26762
2026-08-08T17:41:47Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2038 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:41:47 dist-test-slave-bqcl krb5kdc[27622](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:41:47 dist-test-slave-bqcl krb5kdc[27622](info): set up 2 sockets
Aug 08 17:41:47 dist-test-slave-bqcl krb5kdc[27622](info): commencing operation
krb5kdc: starting...
W20260808 17:41:48.530575 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:41:48 dist-test-slave-bqcl krb5kdc[27622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:41:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:41:48Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.187.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.187.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/rangeradmin_127.9.187.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/rangeradmin_127.9.187.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.187.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.187.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/rangerlookup_127.9.187.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/rangerlookup_127.9.187.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.187.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.187.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/HTTP_127.9.187.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/HTTP_127.9.187.212@KRBTEST.COM.keytab.
I20260808 17:41:48.700737 9967 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskejXIA2/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/postgres -l logfile start
2026-08-08 17:41:51.015 UTC [27679] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 17:41:51.015 UTC [27679] LOG: listening on IPv4 address "127.9.187.212", port 36389
2026-08-08 17:41:51.018 UTC [27679] LOG: listening on Unix socket "/tmp/.s.PGSQL.36389"
2026-08-08 17:41:51.038 UTC [27691] LOG: database system was shut down at 2026-08-08 17:41:49 UTC
2026-08-08 17:41:51.042 UTC [27679] LOG: database system is ready to accept connections
I20260808 17:41:52.106357 9967 mini_postgres.cc:96] Postgres bound to 36389
2026-08-08 17:41:52.114 UTC [27702] FATAL: database "slave" does not exist
127.9.187.212:36389 - accepting connections
I20260808 17:41:52.115016 9967 mini_ranger.cc:161] Starting Ranger...
I20260808 17:41:52.130178 9967 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 17:41:52.553297 9967 mini_ranger.cc:87] Created ranger Postgres database
I20260808 17:41:52.553385 9967 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-admin
2026-08-08 17:41:52,906 [I] DB FLAVOR :POSTGRES
2026-08-08 17:41:52,906 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 17:41:52,906 [I] Checking connection..
2026-08-08 17:41:52,906 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 17:41:53,179 [I] Checking connection passed.
2026-08-08 17:41:53,179 [I] --------- Verifying version history table ---------
2026-08-08 17:41:53,179 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:41:53,434 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 17:41:53,435 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:41:53,687 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 17:41:53,688 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 17:41:53,688 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 17:41:53.924 UTC [27811] WARNING: there is no transaction in progress
2026-08-08 17:41:53,930 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 17:41:53,931 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:41:54,193 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 17:41:54,193 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 17:41:54,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 17:41:54,449 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 17:41:54,702 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-bqcl.c.gcp-upstream.internal','N') ;"
2026-08-08 17:41:54,933 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 17:41:55,187 [I] Table x_portal_user does not exist in database ranger
2026-08-08 17:41:55,187 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 17:41:55,432 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 17:41:55,432 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 17:41:55,674 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 17:41:55,929 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 17:41:55,929 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 17:41:56.821 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:56.836 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:56.850 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:56.863 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:56.880 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:56.900 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:56.959 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:56.964 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:56.977 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:56.986 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:56.995 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:57.008 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:57.017 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:57.023 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:57.028 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:57.034 UTC [27988] WARNING: there is no transaction in progress
2026-08-08 17:41:57,621 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 17:41:57,621 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 17:41:57,871 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 17:41:57,872 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 17:41:58,129 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 17:41:58,130 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 17:41:58,389 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 17:41:58,389 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 17:41:58,631 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 17:41:58,888 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-bqcl.c.gcp-upstream.internal';"
2026-08-08 17:41:59,136 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 17:41:59,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 17:41:59,394 [I] DB_PATCHES have already been applied
I20260808 17:41:59.400516 9967 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-admin:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskejXIA2/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 17:41:59.400580 9967 mini_ranger.cc:193] Using host: 127.9.187.212
I20260808 17:41:59.404381 9967 mini_ranger.cc:227] Ranger admin URL: http://127.9.187.212:39593
Aug 08, 2026 5:41:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:41:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:41:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 5:41:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 5:41:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 5:42:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 5:42:00 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 17:42:00.609474 9967 mini_ranger.cc:160] Time spent starting Ranger: real 8.494s user 0.010s sys 0.000s
Aug 08, 2026 5:42:20 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 5:42:20 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 5:42:20 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 5:42:20 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 5:42:21 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 17:42:22.408493 9967 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.187.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.187.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/rangerkms_127.9.187.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/rangerkms_127.9.187.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.187.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.187.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.187.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/HTTP_127.9.187.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.187.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/HTTP_127.9.187.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 17:42:22 dist-test-slave-bqcl krb5kdc[27622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210942, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 17:42:22.484599 9967 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 17:42:22.494414 9967 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 17:42:23.235843 9967 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 17:42:23.235917 9967 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-kms
I20260808 17:42:23.235929 9967 mini_ranger_kms.cc:227] Using postgres at 127.9.187.212:36389
2026-08-08 17:42:23,640 [I] DB FLAVOR :POSTGRES
2026-08-08 17:42:23,640 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 17:42:23,640 [I] Checking connection
2026-08-08 17:42:23,640 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 17:42:23,901 [I] connection success
2026-08-08 17:42:23,902 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 17:42:23,902 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 17:42:23,902 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 17:42:24,134 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 17:42:24,134 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 17:42:24,134 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 17:42:24,135 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:36389/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 17:42:24,398 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 17:42:24.864742 9967 mini_ranger_kms.cc:310] Created kms service
I20260808 17:42:25.038456 9967 mini_ranger_kms.cc:326] Created kudu user
I20260808 17:42:25.078867 9967 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 17:42:25 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210942, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:42:25.476810 9967 mini_ranger_kms.cc:384] Added ranger policy
I20260808 17:42:25.476943 9967 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-kms:/tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 17:42:25.476967 9967 mini_ranger_kms.cc:240] Using host: 127.9.187.212
I20260808 17:42:25.481178 9967 mini_ranger_kms.cc:276] Ranger KMS PID: 28281
I20260808 17:42:25.481330 9967 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.187.212:41593
Aug 08, 2026 5:42:26 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:42:26 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:42:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 5:42:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 5:42:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 5:42:27 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 17:42:27 dist-test-slave-bqcl krb5kdc[27622](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786210947, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.187.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:42:28.063378 9967 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.579s user 0.003s sys 0.378s
I20260808 17:42:28.063601 9967 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 17:42:28.063700 9967 mini_ranger_kms.cc:401] 127.9.187.212:41593/kms/v1/keys
Aug 08 17:42:28 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210947, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.187.212@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
Aug 08 17:42:28 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210947, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.187.212@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
Aug 08 17:42:30 dist-test-slave-bqcl krb5kdc[27622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210950, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:42:30.828687 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:39839
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:39839
--ranger_config_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:41593/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:42:30.920572 28381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:42:30.920787 28381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:42:30.920811 28381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:42:30.921983 28381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:42:30.922031 28381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:42:30.922046 28381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:42:30.922060 28381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:42:30.922072 28381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:42:30.923790 28381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.187.212:41593/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:39839
--ranger_config_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:39839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:42:30.924028 28381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:42:30.924260 28381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:42:30.930612 28391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:42:30.930708 28396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:42:30.930783 28381 server_base.cc:1034] running on GCE node
W20260808 17:42:30.930851 28390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:42:30.931084 28381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:42:30.931370 28381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:42:30.932508 28381 hybrid_clock.cc:648] HybridClock initialized: now 1786210950932495 us; error 31 us; skew 500 ppm
Aug 08 17:42:30 dist-test-slave-bqcl krb5kdc[27622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210950, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:42:30.935061 28381 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:42:30.935629 28381 webserver.cc:460] Webserver started at http://127.9.187.254:42639/ using document root <none> and password file <none>
I20260808 17:42:30.935842 28381 fs_manager.cc:359] Metadata directory not provided
I20260808 17:42:30.935884 28381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:42:30.936004 28381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:42:30 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210950, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:42:30.983366 28381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "bdc1828c1f4940f1ad9d195fa5d4004a"
format_stamp: "Formatted at 2026-08-08 17:42:30 on dist-test-slave-bqcl"
server_key: "77fb69ce7dfa4f79c1aa41f0d581a433"
server_key_iv: "b80e20b757a6ee1d428125661ac4ac8f"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:30.983789 28381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "bdc1828c1f4940f1ad9d195fa5d4004a"
format_stamp: "Formatted at 2026-08-08 17:42:30 on dist-test-slave-bqcl"
server_key: "77fb69ce7dfa4f79c1aa41f0d581a433"
server_key_iv: "b80e20b757a6ee1d428125661ac4ac8f"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:30.985363 28381 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 17:42:30.996708 28403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:42:30.996904 28381 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:42:30.997008 28381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "bdc1828c1f4940f1ad9d195fa5d4004a"
format_stamp: "Formatted at 2026-08-08 17:42:30 on dist-test-slave-bqcl"
server_key: "77fb69ce7dfa4f79c1aa41f0d581a433"
server_key_iv: "b80e20b757a6ee1d428125661ac4ac8f"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:30.997100 28381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:42:31.012339 28381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:42:31.014276 28381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:42:31.014420 28381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:42:31.021579 28381 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:39839
I20260808 17:42:31.021647 28486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:39839 every 8 connection(s)
I20260808 17:42:31.022006 28381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:42:31.022869 28488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:42:31.024148 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 28381
I20260808 17:42:31.024255 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:42:31.024435 9967 external_mini_cluster.cc:1428] Setting key 5dd143e457d06553eb806bdaffab8e19
I20260808 17:42:31.026882 28488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a: Bootstrap starting.
I20260808 17:42:31.027809 28488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a: Neither blocks nor log segments found. Creating new log.
I20260808 17:42:31.028226 28488 log.cc:824] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:42:31.029228 28488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a: No bootstrap required, opened a new log
Aug 08 17:42:31 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210950, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:42:31.031980 28488 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1828c1f4940f1ad9d195fa5d4004a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39839 } }
I20260808 17:42:31.032186 28488 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:42:31.032271 28488 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdc1828c1f4940f1ad9d195fa5d4004a, State: Initialized, Role: FOLLOWER
I20260808 17:42:31.032429 28488 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1828c1f4940f1ad9d195fa5d4004a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39839 } }
I20260808 17:42:31.032557 28488 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:42:31.032608 28488 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:42:31.032660 28488 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:42:31.033309 28488 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1828c1f4940f1ad9d195fa5d4004a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39839 } }
I20260808 17:42:31.033427 28488 leader_election.cc:302] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdc1828c1f4940f1ad9d195fa5d4004a; no voters:
I20260808 17:42:31.033614 28488 leader_election.cc:288] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:42:31.033670 28498 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:42:31.033905 28498 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [term 1 LEADER]: Becoming Leader. State: Replica: bdc1828c1f4940f1ad9d195fa5d4004a, State: Running, Role: LEADER
I20260808 17:42:31.033980 28488 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:42:31.034044 28498 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1828c1f4940f1ad9d195fa5d4004a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39839 } }
I20260808 17:42:31.035076 28499 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdc1828c1f4940f1ad9d195fa5d4004a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1828c1f4940f1ad9d195fa5d4004a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39839 } } }
I20260808 17:42:31.035152 28499 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [sys.catalog]: This master's current role is: LEADER
I20260808 17:42:31.035279 28499 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdc1828c1f4940f1ad9d195fa5d4004a. Latest consensus state: current_term: 1 leader_uuid: "bdc1828c1f4940f1ad9d195fa5d4004a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1828c1f4940f1ad9d195fa5d4004a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39839 } } }
I20260808 17:42:31.035319 28499 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a [sys.catalog]: This master's current role is: LEADER
I20260808 17:42:31.035794 28488 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 17:42:31.036178 28494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:31.024996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35088 (local address 127.9.187.254:39839)
0808 17:42:31.025296 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0808 17:42:31.025305 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:42:31.025348 (+ 43us) server_negotiation.cc:407] Connection header received
0808 17:42:31.025932 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:42:31.025940 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:42:31.025992 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:42:31.026142 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:42:31.026749 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:31.027681 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:31.028473 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:31.028921 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:31.029040 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:31.031925 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:42:31.031929 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:42:31.031929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:42:31.031942 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:42:31.034273 (+ 2331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:42:31.034680 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:42:31.034683 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:42:31.034683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:42:31.034796 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:42:31.034996 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:42:31.034996 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:42:31.034997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:42:31.035325 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:42:31.035493 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 17:42:31.035811 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 17:42:31.035931 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":127,"threads_started":1}
I20260808 17:42:31.035984 28515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:42:31.040390 28515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:42:31.042872 28515 catalog_manager.cc:1347] Generated new cluster ID: 9d4d98ca1980443f8ea8d667df0e3aa6
I20260808 17:42:31.042924 28515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:42:31.055655 28515 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:42:31.056432 28515 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:42:31.066150 28515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a: Generated new TSK 0
I20260808 17:42:31.066382 28515 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:42:31.841437 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:41593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39839
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:42:31.954190 28561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:42:31.954464 28561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:42:31.954506 28561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:42:31.955724 28561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:42:31.955768 28561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:42:31.955796 28561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:42:31.957243 28561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.187.212:41593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:42:31.957458 28561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:42:31.957697 28561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:42:31.964570 28571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:42:31.964573 28567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:42:31.964627 28566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:42:31.964974 28561 server_base.cc:1034] running on GCE node
I20260808 17:42:31.965175 28561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:42:31.965446 28561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:42:31.966612 28561 hybrid_clock.cc:648] HybridClock initialized: now 1786210951966599 us; error 28 us; skew 500 ppm
Aug 08 17:42:31 dist-test-slave-bqcl krb5kdc[27622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210951, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:42:31.969664 28561 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:42:31.970155 28561 webserver.cc:460] Webserver started at http://127.9.187.193:36901/ using document root <none> and password file <none>
I20260808 17:42:31.970376 28561 fs_manager.cc:359] Metadata directory not provided
I20260808 17:42:31.970424 28561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:42:31.970561 28561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:42:31 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210951, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:42:31.986740 28561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570"
format_stamp: "Formatted at 2026-08-08 17:42:31 on dist-test-slave-bqcl"
server_key: "7917b57ff3f924868c28f3b02abbe7ac"
server_key_iv: "0ce057d679430e179e256fa50db42ddb"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:31.987255 28561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570"
format_stamp: "Formatted at 2026-08-08 17:42:31 on dist-test-slave-bqcl"
server_key: "7917b57ff3f924868c28f3b02abbe7ac"
server_key_iv: "0ce057d679430e179e256fa50db42ddb"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:31.989432 28561 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 17:42:32.004279 28586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:42:32.004554 28561 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:42:32.004722 28561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570"
format_stamp: "Formatted at 2026-08-08 17:42:31 on dist-test-slave-bqcl"
server_key: "7917b57ff3f924868c28f3b02abbe7ac"
server_key_iv: "0ce057d679430e179e256fa50db42ddb"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:32.004905 28561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:42:32.016371 28561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:42:32.018744 28561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:42:32.018940 28561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:42:32.019241 28561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:42:32.019655 28561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:42:32.019761 28561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:42:32.019860 28561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:42:32.019936 28561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:42:32.030035 28561 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:34047
I20260808 17:42:32.030599 28561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:42:32.031859 28783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:34047 every 8 connection(s)
I20260808 17:42:32.038779 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 28561
I20260808 17:42:32.038888 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:42:32.039098 9967 external_mini_cluster.cc:1428] Setting key 533d9f55d9d30eaca602d99a0091cd86
Aug 08 17:42:32 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210951, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:42:32.043793 28789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.032527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:39839 (local address 127.9.187.193:56311)
0808 17:42:32.033146 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0808 17:42:32.033191 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 17:42:32.033799 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:42:32.034256 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:42:32.034260 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:42:32.034508 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:42:32.034785 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.034792 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.035821 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.035822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.037082 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.037085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.037654 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.037655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.037804 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.038350 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:42:32.038361 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:42:32.040252 (+ 1891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:42:32.042100 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:42:32.042108 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:42:32.042110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:42:32.042435 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:42:32.042647 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:42:32.042648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:42:32.042648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:42:32.042781 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:42:32.043054 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:42:32.043060 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:42:32.043289 (+ 229us) client_negotiation.cc:769] Sending connection context
0808 17:42:32.043393 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 17:42:32.043547 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":87,"threads_started":1}
I20260808 17:42:32.044200 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.032827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:56311 (local address 127.9.187.254:39839)
0808 17:42:32.033984 (+ 1157us) server_negotiation.cc:206] Beginning negotiation
0808 17:42:32.033986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:42:32.033995 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:42:32.034019 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:42:32.034020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:42:32.034031 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:42:32.034093 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:42:32.034894 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.035701 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.037179 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.037493 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.037552 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.040345 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:42:32.040346 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:42:32.040347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:42:32.040355 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:42:32.042007 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:42:32.042520 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:42:32.042521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:42:32.042521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:42:32.042588 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:42:32.042847 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:42:32.042848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:42:32.042849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:42:32.042977 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:42:32.043031 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:42:32.044037 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0808 17:42:32.044120 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1125,"thread_start_us":84,"threads_started":1}
I20260808 17:42:32.044567 28786 heartbeater.cc:347] Connected to a master server at 127.9.187.254:39839
I20260808 17:42:32.044665 28786 heartbeater.cc:464] Registering TS with master...
I20260808 17:42:32.044837 28786 heartbeater.cc:511] Master 127.9.187.254:39839 requested a full tablet report, sending...
I20260808 17:42:32.045320 28428 ts_manager.cc:194] Registered new tserver with Master: bc2921cf5ecb47bebd9ab4a4d6e49570 (127.9.187.193:34047)
I20260808 17:42:32.045903 28428 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:56311
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:42:32.072762 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:41593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39839
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:42:32.202466 28795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:42:32.202770 28795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:42:32.202809 28795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:42:32.204475 28795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:42:32.204540 28795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:42:32.204577 28795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:42:32.206692 28795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.187.212:41593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:42:32.206938 28795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:42:32.207284 28795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:42:32.214030 28812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:42:32.214838 28807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:42:32.215121 28805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:42:32.215770 28795 server_base.cc:1034] running on GCE node
I20260808 17:42:32.215978 28795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:42:32.216274 28795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:42:32.217450 28795 hybrid_clock.cc:648] HybridClock initialized: now 1786210952217426 us; error 39 us; skew 500 ppm
Aug 08 17:42:32 dist-test-slave-bqcl krb5kdc[27622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210952, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:42:32.220255 28795 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:42:32.220706 28795 webserver.cc:460] Webserver started at http://127.9.187.194:37699/ using document root <none> and password file <none>
I20260808 17:42:32.220928 28795 fs_manager.cc:359] Metadata directory not provided
I20260808 17:42:32.220975 28795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:42:32.221130 28795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:42:32 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210952, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
Aug 08 17:42:32 dist-test-slave-bqcl krb5kdc[27622](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786210952, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:42:32.237520 28795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "80ba068b946a48e1b14a576c767eee3f"
format_stamp: "Formatted at 2026-08-08 17:42:32 on dist-test-slave-bqcl"
server_key: "5febad7dfa1f25e92ee53f9cf2ee7e1a"
server_key_iv: "b63a6d11c91985b46cf0fe2245a389ed"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:32.238159 28795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "80ba068b946a48e1b14a576c767eee3f"
format_stamp: "Formatted at 2026-08-08 17:42:32 on dist-test-slave-bqcl"
server_key: "5febad7dfa1f25e92ee53f9cf2ee7e1a"
server_key_iv: "b63a6d11c91985b46cf0fe2245a389ed"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:32.240137 28795 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260808 17:42:32.254289 28819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:42:32.254464 28795 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:42:32.254555 28795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "80ba068b946a48e1b14a576c767eee3f"
format_stamp: "Formatted at 2026-08-08 17:42:32 on dist-test-slave-bqcl"
server_key: "5febad7dfa1f25e92ee53f9cf2ee7e1a"
server_key_iv: "b63a6d11c91985b46cf0fe2245a389ed"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:32.254644 28795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:42:32.312353 28795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:42:32.314881 28795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:42:32.315096 28795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:42:32.315383 28795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:42:32.315800 28795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:42:32.315886 28795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:42:32.315956 28795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:42:32.316015 28795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:42:32.325850 28795 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:46781
I20260808 17:42:32.326754 28795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:42:32.328625 29018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:46781 every 8 connection(s)
I20260808 17:42:32.335418 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 28795
I20260808 17:42:32.335556 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:42:32.335767 9967 external_mini_cluster.cc:1428] Setting key 75c18757d0350fc304cf15b6d8c45430
Aug 08 17:42:32 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210952, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:42:32.340431 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.329671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:35167 (local address 127.9.187.254:39839)
0808 17:42:32.329717 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:42:32.329720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:42:32.329970 (+ 250us) server_negotiation.cc:407] Connection header received
0808 17:42:32.330706 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:42:32.330708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:42:32.330726 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:42:32.330755 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:42:32.331720 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.332531 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.334103 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.334471 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.334520 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.337199 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:42:32.337201 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:42:32.337201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:42:32.337208 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:42:32.338861 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:42:32.339353 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:42:32.339354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:42:32.339355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:42:32.339418 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:42:32.339696 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:42:32.339697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:42:32.339697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:42:32.339832 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:42:32.339872 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 17:42:32.340243 (+ 371us) server_negotiation.cc:299] Negotiation successful
0808 17:42:32.340334 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:42:32.341161 29022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.329679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:39839 (local address 127.9.187.194:35167)
0808 17:42:32.329844 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 17:42:32.329885 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:42:32.330575 (+ 690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:42:32.330938 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:42:32.330942 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:42:32.331266 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:42:32.331604 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.331611 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.332652 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.332653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.333997 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.334000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.334615 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.334616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.334821 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.335410 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:42:32.335420 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:42:32.337081 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:42:32.338956 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:42:32.338963 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:42:32.338965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:42:32.339262 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:42:32.339487 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:42:32.339488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:42:32.339488 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:42:32.339620 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:42:32.339916 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:42:32.339922 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:42:32.340082 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 17:42:32.340755 (+ 673us) client_negotiation.cc:240] Negotiation successful
0808 17:42:32.340917 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":94,"threads_started":1}
I20260808 17:42:32.341796 29019 heartbeater.cc:347] Connected to a master server at 127.9.187.254:39839
I20260808 17:42:32.341885 29019 heartbeater.cc:464] Registering TS with master...
I20260808 17:42:32.342061 29019 heartbeater.cc:511] Master 127.9.187.254:39839 requested a full tablet report, sending...
I20260808 17:42:32.342510 28428 ts_manager.cc:194] Registered new tserver with Master: 80ba068b946a48e1b14a576c767eee3f (127.9.187.194:46781)
I20260808 17:42:32.342978 28428 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:35167
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:42:32.385793 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:41593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39839
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:42:32.491688 29025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:42:32.491909 29025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:42:32.491942 29025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:42:32.493427 29025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:42:32.493490 29025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:42:32.493538 29025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:42:32.495767 29025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.187.212:41593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:39839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:42:32.496016 29025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:42:32.496323 29025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:42:32.502687 29033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:42:32.502926 29036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:42:32.502737 29031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:42:32.503986 29025 server_base.cc:1034] running on GCE node
I20260808 17:42:32.504212 29025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:42:32.504436 29025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:42:32.505590 29025 hybrid_clock.cc:648] HybridClock initialized: now 1786210952505578 us; error 29 us; skew 500 ppm
Aug 08 17:42:32 dist-test-slave-bqcl krb5kdc[27622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210952, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:42:32.508366 29025 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:42:32.508818 29025 webserver.cc:460] Webserver started at http://127.9.187.195:46015/ using document root <none> and password file <none>
I20260808 17:42:32.509055 29025 fs_manager.cc:359] Metadata directory not provided
I20260808 17:42:32.509104 29025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:42:32.509305 29025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:42:32 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210952, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:42:32.528219 29025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "aa960be1fc4948bdb30bb07e01cff8b3"
format_stamp: "Formatted at 2026-08-08 17:42:32 on dist-test-slave-bqcl"
server_key: "ee54cfd118f1f660344be22cb0f9bdd3"
server_key_iv: "701012e35e0693c18e109bcd7237bccb"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:32.528702 29025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "aa960be1fc4948bdb30bb07e01cff8b3"
format_stamp: "Formatted at 2026-08-08 17:42:32 on dist-test-slave-bqcl"
server_key: "ee54cfd118f1f660344be22cb0f9bdd3"
server_key_iv: "701012e35e0693c18e109bcd7237bccb"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:32.530777 29025 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 17:42:32.544493 29046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:42:32.544777 29025 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:42:32.544945 29025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "aa960be1fc4948bdb30bb07e01cff8b3"
format_stamp: "Formatted at 2026-08-08 17:42:32 on dist-test-slave-bqcl"
server_key: "ee54cfd118f1f660344be22cb0f9bdd3"
server_key_iv: "701012e35e0693c18e109bcd7237bccb"
server_key_version: "kuduclusterkey@0"
I20260808 17:42:32.545115 29025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:42:32.561633 29025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:42:32.572049 29025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:42:32.572284 29025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:42:32.572568 29025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:42:32.572986 29025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:42:32.573045 29025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:42:32.573081 29025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:42:32.573145 29025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:42:32.583706 29025 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:38979
I20260808 17:42:32.584203 29025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:42:32.584332 29240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:38979 every 8 connection(s)
Aug 08 17:42:32 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210952, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:42:32.593645 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 29025
I20260808 17:42:32.593756 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:42:32.593940 9967 external_mini_cluster.cc:1428] Setting key c47ee5fb32dbdc4a1e61c8069ad397f9
I20260808 17:42:32.596179 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.585293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:55129 (local address 127.9.187.254:39839)
0808 17:42:32.585350 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:42:32.585352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:42:32.585540 (+ 188us) server_negotiation.cc:407] Connection header received
0808 17:42:32.586361 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:42:32.586363 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:42:32.586375 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:42:32.586440 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:42:32.587385 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.588160 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.589734 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.590038 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.590080 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.592702 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:42:32.592703 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:42:32.592703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:42:32.592711 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:42:32.594449 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:42:32.595113 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:42:32.595114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:42:32.595115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:42:32.595176 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:42:32.595446 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:42:32.595447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:42:32.595447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:42:32.595593 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:42:32.595636 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:42:32.595999 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 17:42:32.596082 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:42:32.596946 29245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.584977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:39839 (local address 127.9.187.195:55129)
0808 17:42:32.585382 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0808 17:42:32.585432 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 17:42:32.586243 (+ 811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:42:32.586613 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:42:32.586618 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:42:32.586862 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:42:32.587268 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.587275 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.588262 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.588263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.589630 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.589633 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.590190 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.590191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.590334 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.590934 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:42:32.590944 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:42:32.592599 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:42:32.594662 (+ 2063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:42:32.594670 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:42:32.594672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:42:32.595013 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:42:32.595242 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:42:32.595243 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:42:32.595243 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:42:32.595372 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:42:32.595685 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:42:32.595691 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:42:32.595850 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 17:42:32.596509 (+ 659us) client_negotiation.cc:240] Negotiation successful
0808 17:42:32.596680 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":76,"threads_started":1}
I20260808 17:42:32.597555 29241 heartbeater.cc:347] Connected to a master server at 127.9.187.254:39839
I20260808 17:42:32.597692 29241 heartbeater.cc:464] Registering TS with master...
I20260808 17:42:32.597913 29241 heartbeater.cc:511] Master 127.9.187.254:39839 requested a full tablet report, sending...
I20260808 17:42:32.598312 28428 ts_manager.cc:194] Registered new tserver with Master: aa960be1fc4948bdb30bb07e01cff8b3 (127.9.187.195:38979)
I20260808 17:42:32.598811 28428 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:55129
I20260808 17:42:32.599651 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:42:32.613214 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.601377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35092 (local address 127.9.187.254:39839)
0808 17:42:32.601412 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:42:32.601413 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:42:32.601700 (+ 287us) server_negotiation.cc:407] Connection header received
0808 17:42:32.601812 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:42:32.601813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:42:32.601823 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:42:32.601851 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:42:32.606373 (+ 4522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.607093 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.608204 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.608489 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.608545 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.610359 (+ 1814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:42:32.610361 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:42:32.610361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:42:32.610368 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:42:32.611973 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:42:32.612378 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:42:32.612379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:42:32.612380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:42:32.612439 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:42:32.612649 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:42:32.612650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:42:32.612650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:42:32.612772 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:42:32.612863 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 17:42:32.613050 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 17:42:32.613124 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:42:32.615465 28428 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35092:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:42:32.617874 28428 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:42:32.627184 29258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.620874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:34047 (local address 127.0.0.1:43454)
0808 17:42:32.622145 (+ 1271us) negotiation.cc:107] Waiting for socket to connect
0808 17:42:32.622185 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:42:32.622252 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:42:32.623080 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:42:32.623084 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:42:32.623086 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:42:32.623162 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.623163 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.624530 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.624531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.625809 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.625813 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.626878 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.626879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.626964 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.626978 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:42:32.627047 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 17:42:32.627098 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1221,"thread_start_us":150,"threads_started":1}
I20260808 17:42:32.627939 29262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.621565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43454 (local address 127.9.187.193:34047)
0808 17:42:32.622892 (+ 1327us) server_negotiation.cc:206] Beginning negotiation
0808 17:42:32.622896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:42:32.622906 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:42:32.622939 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:42:32.622941 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:42:32.622957 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:42:32.623044 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:42:32.623256 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.624433 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.625912 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.626709 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.626777 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.626841 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:42:32.627462 (+ 621us) server_negotiation.cc:299] Negotiation successful
0808 17:42:32.627542 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1297,"thread_start_us":53,"threads_started":1}
I20260808 17:42:32.628233 29257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.621762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:38979 (local address 127.0.0.1:38344)
0808 17:42:32.623141 (+ 1379us) negotiation.cc:107] Waiting for socket to connect
0808 17:42:32.623151 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:42:32.623201 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:42:32.623451 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:42:32.623452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:42:32.623454 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:42:32.623504 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.623505 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.625039 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.625040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.626243 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.626247 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.628013 (+ 1766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.628014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.628075 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.628079 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:42:32.628132 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 17:42:32.628168 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1363,"thread_start_us":63,"threads_started":1}
I20260808 17:42:32.628487 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.621956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38344 (local address 127.9.187.195:38979)
0808 17:42:32.622768 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0808 17:42:32.622773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:42:32.623256 (+ 483us) server_negotiation.cc:407] Connection header received
0808 17:42:32.623297 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:42:32.623300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:42:32.623315 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:42:32.623382 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:42:32.623595 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.624941 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.626799 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.627765 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.627832 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.627972 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 17:42:32.628374 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 17:42:32.628414 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":779,"thread_start_us":76,"threads_started":1}
I20260808 17:42:32.629122 28667 tablet_service.cc:1467] Processing CreateTablet for tablet d020e3f5e1fe46db8663a98960135ecc (DEFAULT_TABLE table=test-table [id=6e40960e530c4ab199591ea218609151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:42:32.629513 28667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d020e3f5e1fe46db8663a98960135ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:42:32.633646 29265 tablet_bootstrap.cc:492] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570: Bootstrap starting.
I20260808 17:42:32.634244 29125 tablet_service.cc:1467] Processing CreateTablet for tablet d020e3f5e1fe46db8663a98960135ecc (DEFAULT_TABLE table=test-table [id=6e40960e530c4ab199591ea218609151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:42:32.634574 29125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d020e3f5e1fe46db8663a98960135ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:42:32.635082 29265 tablet_bootstrap.cc:654] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570: Neither blocks nor log segments found. Creating new log.
I20260808 17:42:32.635562 29265 log.cc:824] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570: Log is configured to *not* fsync() on all Append() calls
I20260808 17:42:32.638042 29263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.621181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:46781 (local address 127.0.0.1:37814)
0808 17:42:32.622573 (+ 1392us) negotiation.cc:107] Waiting for socket to connect
0808 17:42:32.622583 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:42:32.622629 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:42:32.634498 (+ 11869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:42:32.634499 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:42:32.634502 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:42:32.634545 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.634546 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.635975 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.635976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.637079 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.637082 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.637823 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.637824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.637884 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.637888 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:42:32.637931 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:42:32.637971 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1376,"thread_start_us":105,"threads_started":1}
I20260808 17:42:32.638109 29259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.621503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37814 (local address 127.9.187.194:46781)
0808 17:42:32.634295 (+ 12792us) server_negotiation.cc:206] Beginning negotiation
0808 17:42:32.634301 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 17:42:32.634314 (+ 13us) server_negotiation.cc:407] Connection header received
0808 17:42:32.634356 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:42:32.634358 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:42:32.634375 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:42:32.634624 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:42:32.634709 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.635896 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.637186 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.637746 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.637831 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.637965 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 17:42:32.637993 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 17:42:32.638037 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12694,"thread_start_us":87,"threads_started":1}
I20260808 17:42:32.638902 28904 tablet_service.cc:1467] Processing CreateTablet for tablet d020e3f5e1fe46db8663a98960135ecc (DEFAULT_TABLE table=test-table [id=6e40960e530c4ab199591ea218609151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:42:32.639258 28904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d020e3f5e1fe46db8663a98960135ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:42:32.639580 29270 tablet_bootstrap.cc:492] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3: Bootstrap starting.
I20260808 17:42:32.640854 29270 tablet_bootstrap.cc:654] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3: Neither blocks nor log segments found. Creating new log.
I20260808 17:42:32.641377 29270 log.cc:824] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3: Log is configured to *not* fsync() on all Append() calls
I20260808 17:42:32.642665 29265 tablet_bootstrap.cc:492] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570: No bootstrap required, opened a new log
I20260808 17:42:32.642792 29265 ts_tablet_manager.cc:1397] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260808 17:42:32.645530 29265 raft_consensus.cc:348] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34047 } } peers { permanent_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38979 } } peers { permanent_uuid: "80ba068b946a48e1b14a576c767eee3f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 46781 } }
I20260808 17:42:32.645709 29265 raft_consensus.cc:374] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:42:32.645754 29265 raft_consensus.cc:729] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc2921cf5ecb47bebd9ab4a4d6e49570, State: Initialized, Role: FOLLOWER
I20260808 17:42:32.646198 29265 consensus_queue.cc:260] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34047 } } peers { permanent_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38979 } } peers { permanent_uuid: "80ba068b946a48e1b14a576c767eee3f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 46781 } }
I20260808 17:42:32.646492 29265 ts_tablet_manager.cc:1428] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260808 17:42:32.646631 28786 heartbeater.cc:503] Master 127.9.187.254:39839 was elected leader, sending a full tablet report...
I20260808 17:42:32.646762 29270 tablet_bootstrap.cc:492] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3: No bootstrap required, opened a new log
I20260808 17:42:32.646766 29274 tablet_bootstrap.cc:492] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f: Bootstrap starting.
I20260808 17:42:32.646893 29270 ts_tablet_manager.cc:1397] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s
I20260808 17:42:32.649489 29274 tablet_bootstrap.cc:654] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f: Neither blocks nor log segments found. Creating new log.
I20260808 17:42:32.649520 29270 raft_consensus.cc:348] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34047 } } peers { permanent_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38979 } } peers { permanent_uuid: "80ba068b946a48e1b14a576c767eee3f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 46781 } }
I20260808 17:42:32.649835 29270 raft_consensus.cc:374] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:42:32.649946 29270 raft_consensus.cc:729] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa960be1fc4948bdb30bb07e01cff8b3, State: Initialized, Role: FOLLOWER
I20260808 17:42:32.650080 29274 log.cc:824] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:42:32.650215 29270 consensus_queue.cc:260] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34047 } } peers { permanent_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38979 } } peers { permanent_uuid: "80ba068b946a48e1b14a576c767eee3f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 46781 } }
I20260808 17:42:32.650573 29270 ts_tablet_manager.cc:1428] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 17:42:32.650774 29241 heartbeater.cc:503] Master 127.9.187.254:39839 was elected leader, sending a full tablet report...
I20260808 17:42:32.650979 29274 tablet_bootstrap.cc:492] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f: No bootstrap required, opened a new log
I20260808 17:42:32.651036 29274 ts_tablet_manager.cc:1397] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 17:42:32.653591 29274 raft_consensus.cc:348] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34047 } } peers { permanent_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38979 } } peers { permanent_uuid: "80ba068b946a48e1b14a576c767eee3f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 46781 } }
I20260808 17:42:32.653751 29274 raft_consensus.cc:374] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:42:32.653785 29274 raft_consensus.cc:729] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80ba068b946a48e1b14a576c767eee3f, State: Initialized, Role: FOLLOWER
I20260808 17:42:32.653916 29274 consensus_queue.cc:260] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34047 } } peers { permanent_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38979 } } peers { permanent_uuid: "80ba068b946a48e1b14a576c767eee3f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 46781 } }
I20260808 17:42:32.654223 29274 ts_tablet_manager.cc:1428] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:42:32.654383 29019 heartbeater.cc:503] Master 127.9.187.254:39839 was elected leader, sending a full tablet report...
I20260808 17:42:32.673185 29277 raft_consensus.cc:482] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:42:32.673332 29277 raft_consensus.cc:504] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34047 } } peers { permanent_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38979 } } peers { permanent_uuid: "80ba068b946a48e1b14a576c767eee3f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 46781 } }
I20260808 17:42:32.673712 29277 leader_election.cc:288] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa960be1fc4948bdb30bb07e01cff8b3 (127.9.187.195:38979), 80ba068b946a48e1b14a576c767eee3f (127.9.187.194:46781)
I20260808 17:42:32.679152 29259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.674096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:48575 (local address 127.9.187.194:46781)
0808 17:42:32.674174 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 17:42:32.674177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:42:32.674479 (+ 302us) server_negotiation.cc:407] Connection header received
0808 17:42:32.674515 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:42:32.674516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:42:32.674526 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:42:32.674592 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:42:32.675416 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.676240 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.677834 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.678433 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.678486 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.678496 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:42:32.679016 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 17:42:32.679076 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 17:42:32.679598 29284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.673927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:46781 (local address 127.9.187.193:48575)
0808 17:42:32.674398 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0808 17:42:32.674408 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:42:32.674470 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:42:32.674657 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:42:32.674659 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:42:32.674661 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:42:32.674976 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.674979 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.676429 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.676430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.677722 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.677725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.678851 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.678852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.678932 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.678936 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:42:32.679452 (+ 516us) client_negotiation.cc:240] Negotiation successful
0808 17:42:32.679499 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":2,"thread_start_us":113,"threads_started":1}
I20260808 17:42:32.679618 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.674323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:54603 (local address 127.9.187.195:38979)
0808 17:42:32.674371 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:42:32.674372 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:42:32.674593 (+ 221us) server_negotiation.cc:407] Connection header received
0808 17:42:32.674677 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:42:32.674678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:42:32.674689 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:42:32.674717 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:42:32.676223 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.677044 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.678570 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.679134 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.679178 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.679185 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:42:32.679507 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 17:42:32.679549 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:42:32.679873 29288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.674248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:38979 (local address 127.9.187.193:54603)
0808 17:42:32.674544 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 17:42:32.674551 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 17:42:32.674613 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:42:32.674776 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:42:32.674776 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:42:32.674778 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:42:32.675309 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.675312 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.677215 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.677216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.678478 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:42:32.678481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.679241 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.679242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:42:32.679419 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.679422 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:42:32.679693 (+ 271us) client_negotiation.cc:240] Negotiation successful
0808 17:42:32.679735 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":238,"thread_start_us":77,"threads_started":1}
I20260808 17:42:32.680277 28928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d020e3f5e1fe46db8663a98960135ecc" candidate_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80ba068b946a48e1b14a576c767eee3f" is_pre_election: true
I20260808 17:42:32.680444 28928 raft_consensus.cc:2454] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc2921cf5ecb47bebd9ab4a4d6e49570 in term 0.
I20260808 17:42:32.680680 29170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d020e3f5e1fe46db8663a98960135ecc" candidate_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" is_pre_election: true
I20260808 17:42:32.680760 28592 leader_election.cc:302] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80ba068b946a48e1b14a576c767eee3f, bc2921cf5ecb47bebd9ab4a4d6e49570; no voters:
I20260808 17:42:32.680825 29170 raft_consensus.cc:2454] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc2921cf5ecb47bebd9ab4a4d6e49570 in term 0.
I20260808 17:42:32.680897 29277 raft_consensus.cc:2781] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:42:32.680934 29277 raft_consensus.cc:482] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:42:32.680960 29277 raft_consensus.cc:3037] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:42:32.681947 29277 raft_consensus.cc:504] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34047 } } peers { permanent_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38979 } } peers { permanent_uuid: "80ba068b946a48e1b14a576c767eee3f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 46781 } }
I20260808 17:42:32.682092 29277 leader_election.cc:288] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [CANDIDATE]: Term 1 election: Requested vote from peers aa960be1fc4948bdb30bb07e01cff8b3 (127.9.187.195:38979), 80ba068b946a48e1b14a576c767eee3f (127.9.187.194:46781)
I20260808 17:42:32.682417 29170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d020e3f5e1fe46db8663a98960135ecc" candidate_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa960be1fc4948bdb30bb07e01cff8b3"
I20260808 17:42:32.682493 29170 raft_consensus.cc:3037] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:42:32.682552 28928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d020e3f5e1fe46db8663a98960135ecc" candidate_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80ba068b946a48e1b14a576c767eee3f"
I20260808 17:42:32.682633 28928 raft_consensus.cc:3037] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:42:32.683481 29170 raft_consensus.cc:2454] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc2921cf5ecb47bebd9ab4a4d6e49570 in term 1.
I20260808 17:42:32.683660 28593 leader_election.cc:302] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa960be1fc4948bdb30bb07e01cff8b3, bc2921cf5ecb47bebd9ab4a4d6e49570; no voters:
I20260808 17:42:32.683734 29277 raft_consensus.cc:2781] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:42:32.683871 29277 raft_consensus.cc:686] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [term 1 LEADER]: Becoming Leader. State: Replica: bc2921cf5ecb47bebd9ab4a4d6e49570, State: Running, Role: LEADER
I20260808 17:42:32.683954 29277 consensus_queue.cc:237] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34047 } } peers { permanent_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38979 } } peers { permanent_uuid: "80ba068b946a48e1b14a576c767eee3f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 46781 } }
I20260808 17:42:32.684033 28928 raft_consensus.cc:2454] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc2921cf5ecb47bebd9ab4a4d6e49570 in term 1.
I20260808 17:42:32.684912 28428 catalog_manager.cc:5495] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc2921cf5ecb47bebd9ab4a4d6e49570 (127.9.187.193). New cstate: current_term: 1 leader_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2921cf5ecb47bebd9ab4a4d6e49570" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80ba068b946a48e1b14a576c767eee3f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 46781 } health_report { overall_health: UNKNOWN } } }
I20260808 17:42:32.700871 29262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.695871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43460 (local address 127.9.187.193:34047)
0808 17:42:32.695911 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:42:32.695913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:42:32.695919 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:42:32.695952 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:42:32.695953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:42:32.695973 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:42:32.696234 (+ 261us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:42:32.696420 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.697455 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.699535 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:42:32.699983 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:42:32.700117 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:42:32.700284 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:42:32.700423 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:42:32.700511 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 17:42:32.700657 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 17:42:32.700705 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:42:32.704035 28928 raft_consensus.cc:1261] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f [term 1 FOLLOWER]: Refusing update from remote peer bc2921cf5ecb47bebd9ab4a4d6e49570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:42:32.704490 29291 consensus_queue.cc:1035] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80ba068b946a48e1b14a576c767eee3f" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 46781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:42:32.707067 29170 raft_consensus.cc:1261] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3 [term 1 FOLLOWER]: Refusing update from remote peer bc2921cf5ecb47bebd9ab4a4d6e49570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:42:32.707319 29291 consensus_queue.cc:1035] T d020e3f5e1fe46db8663a98960135ecc P bc2921cf5ecb47bebd9ab4a4d6e49570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa960be1fc4948bdb30bb07e01cff8b3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:42:32.716426 29299 mvcc.cc:205] Tried to move back new op lower bound from 7316320062272487424 to 7316320062194069504. Current Snapshot: MvccSnapshot[applied={T|T < 7316320062272487424}]
I20260808 17:42:32.716601 29311 mvcc.cc:205] Tried to move back new op lower bound from 7316320062272487424 to 7316320062194069504. Current Snapshot: MvccSnapshot[applied={T|T < 7316320062272487424}]
I20260808 17:42:32.721251 29300 mvcc.cc:205] Tried to move back new op lower bound from 7316320062272487424 to 7316320062194069504. Current Snapshot: MvccSnapshot[applied={T|T < 7316320062272487424}]
I20260808 17:42:32.728876 28428 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35092:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:42:32.728977 28428 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35092:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:42:32.729686 28428 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bdc1828c1f4940f1ad9d195fa5d4004a: Sending DeleteTablet for 3 replicas of tablet d020e3f5e1fe46db8663a98960135ecc
I20260808 17:42:32.730103 28667 tablet_service.cc:1514] Processing DeleteTablet for tablet d020e3f5e1fe46db8663a98960135ecc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:42:32 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:43454
I20260808 17:42:32.730355 28904 tablet_service.cc:1514] Processing DeleteTablet for tablet d020e3f5e1fe46db8663a98960135ecc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:42:32 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:37814
I20260808 17:42:32.730808 29125 tablet_service.cc:1514] Processing DeleteTablet for tablet d020e3f5e1fe46db8663a98960135ecc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:42:32 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:38344
I20260808 17:42:32.731376 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 28561
Aug 08 17:42:32 dist-test-slave-bqcl krb5kdc[27622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210952, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:42:32.747462 29325 tablet_replica.cc:330] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3: stopping tablet replica
I20260808 17:42:32.747675 29325 raft_consensus.cc:2229] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:42:32.747821 29325 raft_consensus.cc:2258] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:42:32.747934 29324 tablet_replica.cc:330] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f: stopping tablet replica
I20260808 17:42:32.748175 29324 raft_consensus.cc:2229] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:42:32.748667 29325 ts_tablet_manager.cc:1905] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:42:32.748824 29324 raft_consensus.cc:2258] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:42:32.750293 29324 ts_tablet_manager.cc:1905] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:42:32.753377 29324 ts_tablet_manager.cc:1918] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:42:32.753508 29324 log.cc:1196] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/d020e3f5e1fe46db8663a98960135ecc
I20260808 17:42:32.754330 29324 ts_tablet_manager.cc:1939] T d020e3f5e1fe46db8663a98960135ecc P 80ba068b946a48e1b14a576c767eee3f: Deleting consensus metadata
I20260808 17:42:32.754858 28410 catalog_manager.cc:4841] TS 80ba068b946a48e1b14a576c767eee3f (127.9.187.194:46781): tablet d020e3f5e1fe46db8663a98960135ecc (table test-table [id=6e40960e530c4ab199591ea218609151]) successfully deleted
I20260808 17:42:32.759443 29325 ts_tablet_manager.cc:1918] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:42:32.759534 29325 log.cc:1196] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/d020e3f5e1fe46db8663a98960135ecc
W20260808 17:42:32.760056 28410 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:34047 (error 108)
I20260808 17:42:32.760274 29325 ts_tablet_manager.cc:1939] T d020e3f5e1fe46db8663a98960135ecc P aa960be1fc4948bdb30bb07e01cff8b3: Deleting consensus metadata
I20260808 17:42:32.760675 29263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:42:32.760525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:34047 (local address 127.0.0.1:43474)
0808 17:42:32.760592 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 17:42:32.760637 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:34047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 17:42:32.760715 28411 catalog_manager.cc:4841] TS aa960be1fc4948bdb30bb07e01cff8b3 (127.9.187.195:38979): tablet d020e3f5e1fe46db8663a98960135ecc (table test-table [id=6e40960e530c4ab199591ea218609151]) successfully deleted
W20260808 17:42:32.760782 28410 catalog_manager.cc:4584] TS bc2921cf5ecb47bebd9ab4a4d6e49570 (127.9.187.193:34047): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d020e3f5e1fe46db8663a98960135ecc: Network error: Client connection negotiation failed: client connection to 127.9.187.193:34047: connect: Connection refused (error 111)
I20260808 17:42:32.761018 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 28795
I20260808 17:42:32.773684 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 29025
I20260808 17:42:32.782508 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 28381
I20260808 17:42:32.798187 9967 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 17:42:33.144522 9967 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 17:42:33.144645 9967 mini_ranger.cc:66] Stopping Ranger...
I20260808 17:42:33.487874 9967 mini_ranger.cc:68] Stopped Ranger
2026-08-08 17:42:33.488 UTC [27679] LOG: received smart shutdown request
2026-08-08 17:42:33.491 UTC [27679] LOG: background worker "logical replication launcher" (PID 27698) exited with exit code 1
2026-08-08 17:42:33.492 UTC [27692] LOG: shutting down
2026-08-08 17:42:33.634 UTC [27679] LOG: database system is shut down
2026-08-08T17:42:33Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46338 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:42:33 dist-test-slave-bqcl krb5kdc[29340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:42:33 dist-test-slave-bqcl krb5kdc[29340](info): set up 2 sockets
Aug 08 17:42:33 dist-test-slave-bqcl krb5kdc[29340](info): commencing operation
krb5kdc: starting...
W20260808 17:42:34.870654 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:42:34 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:42:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:42:34Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.187.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.187.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/rangeradmin_127.9.187.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/rangeradmin_127.9.187.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.187.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.187.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/rangerlookup_127.9.187.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/rangerlookup_127.9.187.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.187.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.187.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/HTTP_127.9.187.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/HTTP_127.9.187.212@KRBTEST.COM.keytab.
I20260808 17:42:35.040079 9967 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskejXIA2/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/postgres -l logfile start
2026-08-08 17:42:37.252 UTC [29385] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 17:42:37.252 UTC [29385] LOG: listening on IPv4 address "127.9.187.212", port 38771
2026-08-08 17:42:37.255 UTC [29385] LOG: listening on Unix socket "/tmp/.s.PGSQL.38771"
2026-08-08 17:42:37.283 UTC [29389] LOG: database system was shut down at 2026-08-08 17:42:36 UTC
2026-08-08 17:42:37.286 UTC [29385] LOG: database system is ready to accept connections
I20260808 17:42:38.338440 9967 mini_postgres.cc:96] Postgres bound to 38771
2026-08-08 17:42:38.345 UTC [29402] FATAL: database "slave" does not exist
127.9.187.212:38771 - accepting connections
I20260808 17:42:38.346016 9967 mini_ranger.cc:161] Starting Ranger...
I20260808 17:42:38.360625 9967 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 17:42:38.763464 9967 mini_ranger.cc:87] Created ranger Postgres database
I20260808 17:42:38.763538 9967 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-admin
2026-08-08 17:42:39,024 [I] DB FLAVOR :POSTGRES
2026-08-08 17:42:39,025 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 17:42:39,025 [I] Checking connection..
2026-08-08 17:42:39,025 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 17:42:39,280 [I] Checking connection passed.
2026-08-08 17:42:39,280 [I] --------- Verifying version history table ---------
2026-08-08 17:42:39,281 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:42:39,539 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 17:42:39,539 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:42:39,797 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 17:42:39,797 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 17:42:39,797 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 17:42:40.048 UTC [29508] WARNING: there is no transaction in progress
2026-08-08 17:42:40,056 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 17:42:40,056 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:42:40,292 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 17:42:40,293 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 17:42:40,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 17:42:40,545 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 17:42:40,772 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-bqcl.c.gcp-upstream.internal','N') ;"
2026-08-08 17:42:41,021 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 17:42:41,253 [I] Table x_portal_user does not exist in database ranger
2026-08-08 17:42:41,253 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 17:42:41,509 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 17:42:41,510 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 17:42:41,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 17:42:42,017 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 17:42:42,017 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 17:42:42.907 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:42.924 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:42.940 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:42.954 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:42.972 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:42.991 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:43.053 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:43.059 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:43.074 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:43.083 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:43.092 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:43.104 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:43.113 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:43.119 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:43.125 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:43.131 UTC [29689] WARNING: there is no transaction in progress
2026-08-08 17:42:43,710 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 17:42:43,710 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 17:42:43,958 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 17:42:43,958 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 17:42:44,205 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 17:42:44,205 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 17:42:44,461 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 17:42:44,461 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 17:42:44,705 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 17:42:44,928 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-bqcl.c.gcp-upstream.internal';"
2026-08-08 17:42:45,153 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 17:42:45,153 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 17:42:45,404 [I] DB_PATCHES have already been applied
I20260808 17:42:45.410383 9967 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-admin:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskejXIA2/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 17:42:45.410446 9967 mini_ranger.cc:193] Using host: 127.9.187.212
I20260808 17:42:45.414201 9967 mini_ranger.cc:227] Ranger admin URL: http://127.9.187.212:36555
Aug 08, 2026 5:42:45 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:42:45 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:42:45 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 5:42:45 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 5:42:45 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 5:42:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 5:42:46 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 17:42:46.692819 9967 mini_ranger.cc:160] Time spent starting Ranger: real 8.347s user 0.003s sys 0.006s
Aug 08, 2026 5:43:05 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 5:43:06 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 5:43:06 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 5:43:06 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 5:43:06 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 17:43:07.535971 9967 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.187.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.187.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/rangerkms_127.9.187.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.187.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/rangerkms_127.9.187.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.187.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.187.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.187.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/HTTP_127.9.187.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.187.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/HTTP_127.9.187.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 17:43:07 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210987, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 17:43:07.634470 9967 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 17:43:07.644790 9967 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 17:43:08.398521 9967 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 17:43:08.398615 9967 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-kms
I20260808 17:43:08.398633 9967 mini_ranger_kms.cc:227] Using postgres at 127.9.187.212:38771
2026-08-08 17:43:08,557 [I] DB FLAVOR :POSTGRES
2026-08-08 17:43:08,557 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 17:43:08,557 [I] Checking connection
2026-08-08 17:43:08,557 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 17:43:08,796 [I] connection success
2026-08-08 17:43:08,796 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 17:43:08,796 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 17:43:08,796 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 17:43:09,021 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 17:43:09,021 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 17:43:09,021 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 17:43:09,021 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.187.212:38771/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 17:43:09,293 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 17:43:09.759742 9967 mini_ranger_kms.cc:310] Created kms service
I20260808 17:43:09.980357 9967 mini_ranger_kms.cc:326] Created kudu user
I20260808 17:43:10.021526 9967 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 17:43:10 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210987, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:43:10.408859 9967 mini_ranger_kms.cc:384] Added ranger policy
I20260808 17:43:10.409071 9967 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-kms:/tmp/dist-test-taskejXIA2/build/release/bin/postgresql.jar:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskejXIA2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 17:43:10.409093 9967 mini_ranger_kms.cc:240] Using host: 127.9.187.212
I20260808 17:43:10.413359 9967 mini_ranger_kms.cc:276] Ranger KMS PID: 30002
I20260808 17:43:10.413448 9967 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.187.212:42901
Aug 08, 2026 5:43:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:43:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:43:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 5:43:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 5:43:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 5:43:11 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 17:43:12 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786210992, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.187.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:12.949602 9967 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.315s user 0.014s sys 0.126s
I20260808 17:43:12.949707 9967 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 17:43:12.949751 9967 mini_ranger_kms.cc:401] 127.9.187.212:42901/kms/v1/keys
Aug 08 17:43:12 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210992, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.187.212@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
Aug 08 17:43:13 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210992, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.187.212@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
Aug 08 17:43:15 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210995, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:43:15.523258 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41315
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:41315
--ranger_config_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:42901/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:15.605852 30095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:15.606058 30095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:15.606088 30095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:15.607241 30095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:43:15.607286 30095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:15.607304 30095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:15.607319 30095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:43:15.607335 30095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:43:15.608875 30095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.187.212:42901/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:41315
--ranger_config_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:15.609108 30095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:15.609311 30095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:43:15.614053 30095 server_base.cc:1034] running on GCE node
W20260808 17:43:15.614109 30102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:15.614161 30103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:15.614212 30106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:15.614655 30095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:15.614948 30095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:15.616086 30095 hybrid_clock.cc:648] HybridClock initialized: now 1786210995616073 us; error 29 us; skew 500 ppm
Aug 08 17:43:15 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210995, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:15.622313 30095 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:43:15.622725 30095 webserver.cc:460] Webserver started at http://127.9.187.254:39445/ using document root <none> and password file <none>
I20260808 17:43:15.622915 30095 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:15.622956 30095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:15.623088 30095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:43:15 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210995, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:43:15.685269 30095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "1071c40a08b644b5b3f5731621d1849a"
format_stamp: "Formatted at 2026-08-08 17:43:15 on dist-test-slave-bqcl"
server_key: "800007f337e0dc6794613d93192426a1"
server_key_iv: "d9738f3676eb7f1bdde0a00fa6c9474e"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:15.685809 30095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "1071c40a08b644b5b3f5731621d1849a"
format_stamp: "Formatted at 2026-08-08 17:43:15 on dist-test-slave-bqcl"
server_key: "800007f337e0dc6794613d93192426a1"
server_key_iv: "d9738f3676eb7f1bdde0a00fa6c9474e"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:15.687482 30095 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:43:15.699110 30120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:15.699339 30095 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:43:15.699455 30095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "1071c40a08b644b5b3f5731621d1849a"
format_stamp: "Formatted at 2026-08-08 17:43:15 on dist-test-slave-bqcl"
server_key: "800007f337e0dc6794613d93192426a1"
server_key_iv: "d9738f3676eb7f1bdde0a00fa6c9474e"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:15.699553 30095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:15.712412 30095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:15.714205 30095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:15.714331 30095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:15.718787 30095 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:41315
I20260808 17:43:15.718863 30212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:41315 every 8 connection(s)
I20260808 17:43:15.719192 30095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:43:15.719450 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 30095
I20260808 17:43:15.719560 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:43:15.719718 9967 external_mini_cluster.cc:1428] Setting key aa2a2dd91dcaf64dbe4b17b9330e0c8b
I20260808 17:43:15.720002 30214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:15.723778 30214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a: Bootstrap starting.
I20260808 17:43:15.724530 30214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:15.724852 30214 log.cc:824] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:15.725647 30214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a: No bootstrap required, opened a new log
Aug 08 17:43:15 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210995, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:15.728204 30214 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } }
I20260808 17:43:15.728381 30214 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:15.728413 30214 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1071c40a08b644b5b3f5731621d1849a, State: Initialized, Role: FOLLOWER
I20260808 17:43:15.728578 30214 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } }
I20260808 17:43:15.728668 30214 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:43:15.728729 30214 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:43:15.728785 30214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:15.729444 30214 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } }
I20260808 17:43:15.729558 30214 leader_election.cc:302] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1071c40a08b644b5b3f5731621d1849a; no voters:
I20260808 17:43:15.729723 30214 leader_election.cc:288] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:43:15.729777 30224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:43:15.730031 30224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 1 LEADER]: Becoming Leader. State: Replica: 1071c40a08b644b5b3f5731621d1849a, State: Running, Role: LEADER
I20260808 17:43:15.730079 30214 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:43:15.730221 30224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } }
I20260808 17:43:15.730538 30224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1071c40a08b644b5b3f5731621d1849a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } } }
I20260808 17:43:15.730702 30224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:15.730893 30224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1071c40a08b644b5b3f5731621d1849a. Latest consensus state: current_term: 1 leader_uuid: "1071c40a08b644b5b3f5731621d1849a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } } }
I20260808 17:43:15.731017 30224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:15.731210 30238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:43:15.731758 30238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:43:15.732039 30214 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 17:43:15.732046 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:15.720208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60264 (local address 127.9.187.254:41315)
0808 17:43:15.720378 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:15.720388 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:15.722315 (+ 1927us) server_negotiation.cc:407] Connection header received
0808 17:43:15.722758 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:15.722765 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:15.722814 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:15.722937 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:15.723573 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:15.724548 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:15.725460 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:15.725912 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:15.726009 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:15.728235 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:15.728240 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:15.728240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:15.728252 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:15.729977 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:15.730413 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:15.730415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:15.730416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:15.730514 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:15.730762 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:15.730763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:15.730763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:15.731067 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:15.731649 (+ 582us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:15.731732 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 17:43:15.731853 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260808 17:43:15.738106 30238 catalog_manager.cc:1347] Generated new cluster ID: c383b4afdd8b4fa1b100bfe0b4fff997
I20260808 17:43:15.738230 30238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:43:15.748463 30238 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:43:15.749217 30238 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:43:15.752228 30238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a: Generated new TSK 0
I20260808 17:43:15.752420 30238 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:43:16.417987 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:42901/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41315
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:16.521636 30310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:16.521833 30310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:16.521864 30310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:16.523015 30310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:16.523053 30310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:16.523087 30310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:43:16.524494 30310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.187.212:42901/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:16.524720 30310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:16.524923 30310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:16.530079 30321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:16.530332 30318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:16.530273 30310 server_base.cc:1034] running on GCE node
W20260808 17:43:16.530092 30317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:16.530635 30310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:16.530864 30310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:16.532019 30310 hybrid_clock.cc:648] HybridClock initialized: now 1786210996531997 us; error 35 us; skew 500 ppm
Aug 08 17:43:16 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210996, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:16.534583 30310 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:43:16.535017 30310 webserver.cc:460] Webserver started at http://127.9.187.193:35563/ using document root <none> and password file <none>
I20260808 17:43:16.535255 30310 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:16.535310 30310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:16.535434 30310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:43:16 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210996, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:43:16.549923 30310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b"
format_stamp: "Formatted at 2026-08-08 17:43:16 on dist-test-slave-bqcl"
server_key: "2ca5fb429b2f0b8242113b9ef816c5e2"
server_key_iv: "47ea9924644598b89bf9a6fae4691c2f"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:16.550597 30310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b"
format_stamp: "Formatted at 2026-08-08 17:43:16 on dist-test-slave-bqcl"
server_key: "2ca5fb429b2f0b8242113b9ef816c5e2"
server_key_iv: "47ea9924644598b89bf9a6fae4691c2f"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:16.558552 30310 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.001s sys 0.000s
I20260808 17:43:16.573899 30334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:16.574155 30310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:16.574256 30310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b"
format_stamp: "Formatted at 2026-08-08 17:43:16 on dist-test-slave-bqcl"
server_key: "2ca5fb429b2f0b8242113b9ef816c5e2"
server_key_iv: "47ea9924644598b89bf9a6fae4691c2f"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:16.574344 30310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:16.592871 30310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:16.595419 30310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:16.595649 30310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:16.595985 30310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:16.596429 30310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:16.596527 30310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:16.596628 30310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:16.596702 30310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:16.603600 30310 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:37107
I20260808 17:43:16.603734 30537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:37107 every 8 connection(s)
I20260808 17:43:16.604182 30310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:43:16.604940 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 30310
I20260808 17:43:16.605034 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:43:16.605221 9967 external_mini_cluster.cc:1428] Setting key 068fd168b10521a8683b11b4d23cefc8
Aug 08 17:43:16 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210996, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:16.616456 30540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:16.604958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:41315 (local address 127.9.187.193:58717)
0808 17:43:16.605538 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:16.605590 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:16.606297 (+ 707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:16.606701 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:16.606706 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:16.606960 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:16.607251 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:16.607258 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:16.608284 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:16.608285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:16.609556 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:16.609560 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:16.610080 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:16.610081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:16.610249 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:16.610870 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:16.610881 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:16.612689 (+ 1808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:16.614817 (+ 2128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:16.614824 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:16.614827 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:16.615108 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:16.615331 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:16.615332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:16.615332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:16.615469 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:16.615773 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:16.615779 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:16.615939 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 17:43:16.616045 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 17:43:16.616210 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":88,"threads_started":1}
I20260808 17:43:16.617102 30543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:16.605337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:58717 (local address 127.9.187.254:41315)
0808 17:43:16.605532 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:16.605534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:16.605685 (+ 151us) server_negotiation.cc:407] Connection header received
0808 17:43:16.606469 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:16.606470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:16.606484 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:16.606547 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:16.607365 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:16.608172 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:16.609656 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:16.609963 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:16.610045 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:16.612794 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:16.612795 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:16.612796 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:16.612804 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:16.614723 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:16.615193 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:16.615194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:16.615194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:16.615262 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:16.615545 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:16.615546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:16.615546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:16.615687 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:16.615746 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:16.616857 (+ 1111us) server_negotiation.cc:299] Negotiation successful
0808 17:43:16.616941 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":85,"threads_started":1}
I20260808 17:43:16.617861 30538 heartbeater.cc:347] Connected to a master server at 127.9.187.254:41315
I20260808 17:43:16.617959 30538 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:16.618206 30538 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
I20260808 17:43:16.618821 30152 ts_manager.cc:194] Registered new tserver with Master: dc3e69c8150f4c50b2ad0992bff5ac4b (127.9.187.193:37107)
I20260808 17:43:16.619675 30152 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:58717
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:43:16.644826 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:42901/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41315
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 17:43:16 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786210996, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 17:43:16.766193 30548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:16.766535 30548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:16.766605 30548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:16.768209 30548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:16.768268 30548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:16.768306 30548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:43:16.770445 30548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.187.212:42901/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:16.770855 30548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:16.771152 30548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:16.777508 30563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:16.777616 30560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:16.777774 30566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:16.778865 30548 server_base.cc:1034] running on GCE node
I20260808 17:43:16.779071 30548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:16.779348 30548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:16.780529 30548 hybrid_clock.cc:648] HybridClock initialized: now 1786210996780502 us; error 45 us; skew 500 ppm
Aug 08 17:43:16 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210996, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:16.783720 30548 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:43:16.784129 30548 webserver.cc:460] Webserver started at http://127.9.187.194:33453/ using document root <none> and password file <none>
I20260808 17:43:16.784346 30548 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:16.784415 30548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:16.784550 30548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:43:16 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210996, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:43:16.798620 30548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c"
format_stamp: "Formatted at 2026-08-08 17:43:16 on dist-test-slave-bqcl"
server_key: "09800c693dc05f66306e3eabc5796729"
server_key_iv: "27f23cafc6f7eb75358d852cb7689e3e"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:16.799379 30548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c"
format_stamp: "Formatted at 2026-08-08 17:43:16 on dist-test-slave-bqcl"
server_key: "09800c693dc05f66306e3eabc5796729"
server_key_iv: "27f23cafc6f7eb75358d852cb7689e3e"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:16.802323 30548 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260808 17:43:16.818795 30577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:16.819026 30548 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:43:16.819125 30548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c"
format_stamp: "Formatted at 2026-08-08 17:43:16 on dist-test-slave-bqcl"
server_key: "09800c693dc05f66306e3eabc5796729"
server_key_iv: "27f23cafc6f7eb75358d852cb7689e3e"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:16.819223 30548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:16.836898 30548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:16.839375 30548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:16.839627 30548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:16.839975 30548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:16.840421 30548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:16.840530 30548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:16.840613 30548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:16.840677 30548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:16.847786 30548 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:45891
I20260808 17:43:16.848318 30548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:43:16.851212 30776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:45891 every 8 connection(s)
I20260808 17:43:16.857985 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 30548
I20260808 17:43:16.858101 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:43:16.858330 9967 external_mini_cluster.cc:1428] Setting key 23aa264317ea754c1a441481ef534d03
Aug 08 17:43:16 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210996, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:16.866261 30543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:16.852379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:53915 (local address 127.9.187.254:41315)
0808 17:43:16.852426 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:16.852428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:16.852619 (+ 191us) server_negotiation.cc:407] Connection header received
0808 17:43:16.853321 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:16.853322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:16.853338 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:16.853369 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:16.854234 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:16.855104 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:16.856684 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:16.857015 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:16.857055 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:16.862873 (+ 5818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:16.862874 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:16.862875 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:16.862882 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:16.864571 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:16.865079 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:16.865080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:16.865081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:16.865144 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:16.865462 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:16.865463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:16.865463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:16.865604 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:16.865648 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:16.866041 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 17:43:16.866156 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:43:16.867049 30785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:16.852087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:41315 (local address 127.9.187.194:53915)
0808 17:43:16.852490 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:16.852535 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:16.853191 (+ 656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:16.853558 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:16.853562 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:16.853814 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:16.854099 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:16.854106 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:16.855293 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:16.855294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:16.856582 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:16.856585 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:16.857154 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:16.857154 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:16.857292 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:16.861054 (+ 3762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:16.861065 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:16.862757 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:16.864670 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:16.864677 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:16.864680 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:16.864970 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:16.865215 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:16.865215 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:16.865216 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:16.865384 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:16.865696 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:16.865702 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:16.865871 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 17:43:16.866600 (+ 729us) client_negotiation.cc:240] Negotiation successful
0808 17:43:16.866781 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":88,"threads_started":1}
I20260808 17:43:16.867727 30780 heartbeater.cc:347] Connected to a master server at 127.9.187.254:41315
I20260808 17:43:16.867821 30780 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:16.868024 30780 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
I20260808 17:43:16.868427 30152 ts_manager.cc:194] Registered new tserver with Master: fdb2b1e49ba14d2ea142461a2d7bcd9c (127.9.187.194:45891)
I20260808 17:43:16.868925 30152 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:53915
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:43:16.898712 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:42901/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41315
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:17.018042 30789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:17.018460 30789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:17.018556 30789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:17.020339 30789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:17.020454 30789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:17.020545 30789 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:43:17.022800 30789 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.187.212:42901/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:41315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:17.023277 30789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:17.023633 30789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:17.030967 30801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:17.031728 30797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:17.031998 30805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:17.032037 30789 server_base.cc:1034] running on GCE node
I20260808 17:43:17.032375 30789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:17.032648 30789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:17.033859 30789 hybrid_clock.cc:648] HybridClock initialized: now 1786210997033834 us; error 39 us; skew 500 ppm
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:17.037065 30789 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:43:17.037621 30789 webserver.cc:460] Webserver started at http://127.9.187.195:34381/ using document root <none> and password file <none>
I20260808 17:43:17.037880 30789 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:17.037945 30789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:17.038085 30789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:43:17.050495 30789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "752720562ef64676a3d00b955f7975ac"
format_stamp: "Formatted at 2026-08-08 17:43:17 on dist-test-slave-bqcl"
server_key: "c2532333ce2cc80301a63f2e3961e38d"
server_key_iv: "5da028fad5fc940f0bf0a7d8d120b5f4"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:17.050974 30789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "752720562ef64676a3d00b955f7975ac"
format_stamp: "Formatted at 2026-08-08 17:43:17 on dist-test-slave-bqcl"
server_key: "c2532333ce2cc80301a63f2e3961e38d"
server_key_iv: "5da028fad5fc940f0bf0a7d8d120b5f4"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:17.059029 30789 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.001s sys 0.000s
I20260808 17:43:17.074720 30821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:17.074972 30789 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:43:17.075079 30789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "752720562ef64676a3d00b955f7975ac"
format_stamp: "Formatted at 2026-08-08 17:43:17 on dist-test-slave-bqcl"
server_key: "c2532333ce2cc80301a63f2e3961e38d"
server_key_iv: "5da028fad5fc940f0bf0a7d8d120b5f4"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:17.075165 30789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:17.119835 30789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:17.122387 30789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:17.122588 30789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:17.123018 30789 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:17.123569 30789 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:17.123667 30789 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:17.123726 30789 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:17.123744 30789 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:17.134068 30789 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:42781
I20260808 17:43:17.134822 30789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:43:17.136061 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 30789
I20260808 17:43:17.136179 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:43:17.136664 9967 external_mini_cluster.cc:1428] Setting key e8790919e406e2292b8c1504134bc9a7
I20260808 17:43:17.136814 31018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:42781 every 8 connection(s)
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:17.148716 30543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:17.137809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:51161 (local address 127.9.187.254:41315)
0808 17:43:17.137851 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:17.137853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:17.138187 (+ 334us) server_negotiation.cc:407] Connection header received
0808 17:43:17.139217 (+ 1030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:17.139219 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:17.139231 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:17.139259 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:17.140094 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.140871 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.142442 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.142755 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.142795 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:17.145450 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:17.145451 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:17.145451 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:17.145459 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:17.147155 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:17.147622 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:17.147623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:17.147624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:17.147685 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:17.147957 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:17.147958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:17.147958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:17.148100 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:17.148140 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:17.148535 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 17:43:17.148623 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:43:17.149459 31022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:17.137541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:41315 (local address 127.9.187.195:51161)
0808 17:43:17.137961 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:17.138007 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:17.139086 (+ 1079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:17.139441 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:17.139446 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:17.139692 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:17.139974 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:17.139981 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.140986 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.140987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:17.142346 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:17.142349 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.142913 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.142914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:17.143071 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:17.143653 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:17.143664 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:17.145344 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:17.147254 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:17.147261 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:17.147263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:17.147538 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:17.147749 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:17.147749 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:17.147750 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:17.147889 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:17.148186 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:17.148193 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:17.148361 (+ 168us) client_negotiation.cc:769] Sending connection context
0808 17:43:17.149059 (+ 698us) client_negotiation.cc:240] Negotiation successful
0808 17:43:17.149224 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":82,"threads_started":1}
I20260808 17:43:17.150461 31019 heartbeater.cc:347] Connected to a master server at 127.9.187.254:41315
I20260808 17:43:17.150553 31019 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:17.150734 31019 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
I20260808 17:43:17.151088 30152 ts_manager.cc:194] Registered new tserver with Master: 752720562ef64676a3d00b955f7975ac (127.9.187.195:42781)
I20260808 17:43:17.151530 30152 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:51161
I20260808 17:43:17.158917 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:43:17.159562 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 30310
I20260808 17:43:17.258697 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 30548
I20260808 17:43:17.275441 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 30789
I20260808 17:43:17.287600 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 30095
I20260808 17:43:17.303756 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41315
--webserver_interface=127.9.187.254
--webserver_port=39445
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:41315
--ranger_config_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:42901/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.187.212:42901/kms with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:17.385540 31023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:17.385749 31023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:17.385769 31023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:17.386914 31023 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:43:17.386958 31023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:17.386970 31023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:17.386994 31023 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:43:17.387012 31023 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:43:17.388530 31023 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.187.212:42901/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:41315
--ranger_config_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=39445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:17.388751 31023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:17.388957 31023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:17.393481 31034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:17.393461 31032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:17.393461 31038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:17.393543 31023 server_base.cc:1034] running on GCE node
I20260808 17:43:17.393851 31023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:17.394155 31023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:17.395310 31023 hybrid_clock.cc:648] HybridClock initialized: now 1786210997395290 us; error 31 us; skew 500 ppm
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:17.397624 31023 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:43:17.398067 31023 webserver.cc:460] Webserver started at http://127.9.187.254:39445/ using document root <none> and password file <none>
I20260808 17:43:17.398288 31023 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:17.398347 31023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:43:17.432889 31023 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:17.433550 31050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:17.433748 31023 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:43:17.433863 31023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "1071c40a08b644b5b3f5731621d1849a"
format_stamp: "Formatted at 2026-08-08 17:43:15 on dist-test-slave-bqcl"
server_key: "800007f337e0dc6794613d93192426a1"
server_key_iv: "d9738f3676eb7f1bdde0a00fa6c9474e"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:17.434351 31023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:17.454430 31023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:17.456275 31023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:17.456388 31023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:17.460253 31023 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:41315
I20260808 17:43:17.460325 31130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:41315 every 8 connection(s)
I20260808 17:43:17.460630 31023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:43:17.461807 31131 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:43:17.462467 31131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a: Bootstrap starting.
I20260808 17:43:17.469946 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 31023
I20260808 17:43:17.470244 31131 log.cc:824] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:17.470299 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:42901/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:37107
--local_ip_for_outbound_sockets=127.9.187.193
--tserver_master_addrs=127.9.187.254:41315
--webserver_port=35563
--webserver_interface=127.9.187.193
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.187.212:42901/kms with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:43:17.472311 31131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:43:17.472558 31131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a: Bootstrap complete.
I20260808 17:43:17.475466 31131 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } }
I20260808 17:43:17.475818 31131 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1071c40a08b644b5b3f5731621d1849a, State: Initialized, Role: FOLLOWER
I20260808 17:43:17.475994 31131 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } }
I20260808 17:43:17.476070 31131 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:43:17.476121 31131 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:43:17.476171 31131 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:43:17.477552 31131 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } }
I20260808 17:43:17.477686 31131 leader_election.cc:302] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1071c40a08b644b5b3f5731621d1849a; no voters:
I20260808 17:43:17.477859 31131 leader_election.cc:288] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 17:43:17.477906 31142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 2 FOLLOWER]: Leader election won for term 2
I20260808 17:43:17.478048 31142 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [term 2 LEADER]: Becoming Leader. State: Replica: 1071c40a08b644b5b3f5731621d1849a, State: Running, Role: LEADER
I20260808 17:43:17.478156 31131 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:43:17.478183 31142 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } }
I20260808 17:43:17.478437 31144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1071c40a08b644b5b3f5731621d1849a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } } }
I20260808 17:43:17.478515 31144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:17.478761 31145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1071c40a08b644b5b3f5731621d1849a. Latest consensus state: current_term: 2 leader_uuid: "1071c40a08b644b5b3f5731621d1849a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1071c40a08b644b5b3f5731621d1849a" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41315 } } }
I20260808 17:43:17.478880 31145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:17.478904 31148 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:43:17.479507 31148 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:43:17.479683 31148 catalog_manager.cc:1259] Loaded cluster ID: c383b4afdd8b4fa1b100bfe0b4fff997
I20260808 17:43:17.479759 31148 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:43:17.479894 31131 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 17:43:17.483880 31148 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:43:17.484370 31148 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a: Loaded TSK: 0
I20260808 17:43:17.484669 31148 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:43:17.586591 31141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:17.586863 31141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:17.586901 31141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:17.588512 31141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:17.588562 31141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:17.588599 31141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:43:17.590692 31141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.187.212:42901/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:37107
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=35563
--tserver_master_addrs=127.9.187.254:41315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:17.591063 31141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:17.591357 31141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:17.597380 31202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:17.597388 31203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:17.597386 31209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:17.598393 31141 server_base.cc:1034] running on GCE node
I20260808 17:43:17.598606 31141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:17.598865 31141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:17.600036 31141 hybrid_clock.cc:648] HybridClock initialized: now 1786210997599998 us; error 49 us; skew 500 ppm
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:17.603269 31141 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:43:17.603775 31141 webserver.cc:460] Webserver started at http://127.9.187.193:35563/ using document root <none> and password file <none>
I20260808 17:43:17.604061 31141 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:17.604162 31141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:43:17.622473 31141 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:17.626564 31223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:17.626781 31141 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260808 17:43:17.626869 31141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b"
format_stamp: "Formatted at 2026-08-08 17:43:16 on dist-test-slave-bqcl"
server_key: "2ca5fb429b2f0b8242113b9ef816c5e2"
server_key_iv: "47ea9924644598b89bf9a6fae4691c2f"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:17.627345 31141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:17.663640 31141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:17.671481 31141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:17.671730 31141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:17.671984 31141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:17.672322 31141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:17.672365 31141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:17.672396 31141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:17.672434 31141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:17.677184 31141 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:37107
I20260808 17:43:17.677548 31141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:43:17.680127 31431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:37107 every 8 connection(s)
I20260808 17:43:17.682336 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 31141
I20260808 17:43:17.682638 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:42901/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:45891
--local_ip_for_outbound_sockets=127.9.187.194
--tserver_master_addrs=127.9.187.254:41315
--webserver_port=33453
--webserver_interface=127.9.187.194
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.187.212:42901/kms with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:17.692359 31440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:17.680698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:41315 (local address 127.9.187.193:38651)
0808 17:43:17.680860 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:17.680901 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:17.681449 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:17.682119 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:17.682145 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:17.682367 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:17.682657 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:17.682664 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.684135 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.684135 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:17.685412 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:17.685416 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.686383 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.686384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:17.686518 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:17.687075 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:17.687085 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:17.688533 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:17.690544 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:17.690550 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:17.690552 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:17.690768 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:17.691049 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:17.691050 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:17.691050 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:17.691183 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:17.691698 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:17.691705 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:17.691858 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 17:43:17.691970 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 17:43:17.692126 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":78,"threads_started":1}
I20260808 17:43:17.693306 31441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:17.680821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:38651 (local address 127.9.187.254:41315)
0808 17:43:17.681030 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:17.681038 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:17.681079 (+ 41us) server_negotiation.cc:407] Connection header received
0808 17:43:17.681759 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:17.681765 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:17.681824 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:17.681956 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:17.682796 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.684016 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.685509 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.686166 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.686269 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:17.688662 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:17.688667 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:17.688667 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:17.688687 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:17.690469 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:17.690857 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:17.690860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:17.690861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:17.690973 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:17.691260 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:17.691261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:17.691261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:17.691565 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:17.691664 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:17.692972 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0808 17:43:17.693097 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":107,"threads_started":1}
I20260808 17:43:17.694169 31436 heartbeater.cc:347] Connected to a master server at 127.9.187.254:41315
I20260808 17:43:17.694262 31436 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:17.694435 31436 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
W20260808 17:43:17.695345 31436 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:41315 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 17:43:17.695413 31436 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:17.695474 31436 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
I20260808 17:43:17.695894 31436 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:17.695971 31436 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
W20260808 17:43:17.696302 31436 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:43:17.797441 31442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:17.797652 31442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:17.797675 31442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:17.798852 31442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:17.798897 31442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:17.798928 31442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:43:17.800484 31442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.187.212:42901/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:45891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=33453
--tserver_master_addrs=127.9.187.254:41315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:17.800697 31442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:17.800918 31442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:17.806949 31453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:17.806941 31455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:17.807116 31442 server_base.cc:1034] running on GCE node
W20260808 17:43:17.807180 31458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:17.807410 31442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:17.807711 31442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:17.808944 31442 hybrid_clock.cc:648] HybridClock initialized: now 1786210997808919 us; error 39 us; skew 500 ppm
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:17.812179 31442 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:43:17.812757 31442 webserver.cc:460] Webserver started at http://127.9.187.194:33453/ using document root <none> and password file <none>
I20260808 17:43:17.813007 31442 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:17.813084 31442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:43:17.827459 31442 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:17.828446 31472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:17.828675 31442 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:17.828791 31442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c"
format_stamp: "Formatted at 2026-08-08 17:43:16 on dist-test-slave-bqcl"
server_key: "09800c693dc05f66306e3eabc5796729"
server_key_iv: "27f23cafc6f7eb75358d852cb7689e3e"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:17.829257 31442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:17.849495 31442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:17.851904 31442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:17.852061 31442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:17.852322 31442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:17.852702 31442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:17.852773 31442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:17.852850 31442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:17.852895 31442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:17.863137 31442 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:45891
I20260808 17:43:17.863245 31670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:45891 every 8 connection(s)
I20260808 17:43:17.863678 31442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:43:17.866964 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 31442
I20260808 17:43:17.867265 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.187.212:42901/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:42781
--local_ip_for_outbound_sockets=127.9.187.195
--tserver_master_addrs=127.9.187.254:41315
--webserver_port=34381
--webserver_interface=127.9.187.195
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.187.212:42901/kms with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:17.880918 31441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:17.870224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:49687 (local address 127.9.187.254:41315)
0808 17:43:17.870285 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:17.870288 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:17.870662 (+ 374us) server_negotiation.cc:407] Connection header received
0808 17:43:17.871403 (+ 741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:17.871404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:17.871419 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:17.871488 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:17.872288 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.873038 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.874540 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.874835 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.874880 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:17.877459 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:17.877460 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:17.877460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:17.877468 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:17.879221 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:17.879797 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:17.879799 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:17.879799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:17.879862 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:17.880151 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:17.880152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:17.880153 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:17.880289 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:17.880335 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:17.880737 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 17:43:17.880823 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:43:17.881645 31674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:17.866548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:41315 (local address 127.9.187.194:49687)
0808 17:43:17.870515 (+ 3967us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:17.870565 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:17.871284 (+ 719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:17.871628 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:17.871633 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:17.871869 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:17.872172 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:17.872180 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.873162 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.873162 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:17.874434 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:17.874437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:17.874991 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:17.874992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:17.875130 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:17.875709 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:17.875728 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:17.877344 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:17.879359 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:17.879365 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:17.879368 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:17.879688 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:17.879935 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:17.879936 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:17.879936 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:17.880068 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:17.880387 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:17.880393 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:17.880556 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 17:43:17.881253 (+ 697us) client_negotiation.cc:240] Negotiation successful
0808 17:43:17.881417 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3911,"thread_start_us":85,"threads_started":1}
I20260808 17:43:17.882334 31672 heartbeater.cc:347] Connected to a master server at 127.9.187.254:41315
I20260808 17:43:17.882426 31672 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:17.882604 31672 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
W20260808 17:43:17.883301 31672 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:41315 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 17:43:17.883370 31672 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:17.883426 31672 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
I20260808 17:43:17.883786 31672 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:17.883857 31672 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
W20260808 17:43:17.884171 31672 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:43:17.982033 31678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:17.982385 31678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:17.982446 31678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:17.984048 31678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:17.984165 31678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:17.984236 31678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:43:17.986213 31678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.187.212:42901/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:42781
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=34381
--tserver_master_addrs=127.9.187.254:41315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:17.986443 31678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:17.986696 31678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:17.991495 31688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:17.991534 31695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:17.991487 31691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:17.992074 31678 server_base.cc:1034] running on GCE node
I20260808 17:43:17.992290 31678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:17.992519 31678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:17.993669 31678 hybrid_clock.cc:648] HybridClock initialized: now 1786210997993657 us; error 26 us; skew 500 ppm
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:17.996713 31678 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:43:17.997283 31678 webserver.cc:460] Webserver started at http://127.9.187.195:34381/ using document root <none> and password file <none>
I20260808 17:43:17.997571 31678 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:17.997658 31678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 17:43:17 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:43:18.015499 31678 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:18.016573 31710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:18.016731 31678 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:43:18.016803 31678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "752720562ef64676a3d00b955f7975ac"
format_stamp: "Formatted at 2026-08-08 17:43:17 on dist-test-slave-bqcl"
server_key: "c2532333ce2cc80301a63f2e3961e38d"
server_key_iv: "5da028fad5fc940f0bf0a7d8d120b5f4"
server_key_version: "kuduclusterkey@0"
I20260808 17:43:18.017156 31678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:18.032232 31678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:18.034441 31678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:18.034585 31678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:18.034809 31678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:18.035138 31678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:18.035185 31678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:18.035215 31678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:18.035239 31678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:18.042300 31678 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:42781
I20260808 17:43:18.042392 31881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:42781 every 8 connection(s)
I20260808 17:43:18.042697 31678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:43:18.045821 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 31678
Aug 08 17:43:18 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210997, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:18.052848 31441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:18.043454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:57283 (local address 127.9.187.254:41315)
0808 17:43:18.043507 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:18.043509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:18.043728 (+ 219us) server_negotiation.cc:407] Connection header received
0808 17:43:18.044190 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:18.044192 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:18.044205 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:18.044289 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:18.044796 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:18.045554 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:18.046879 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:18.047088 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:18.047144 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:18.049468 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:18.049470 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:18.049470 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:18.049477 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:18.051178 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:18.051651 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:18.051652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:18.051653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:18.051725 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:18.051994 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:18.051996 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:18.051996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:18.052143 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:18.052223 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:18.052663 (+ 440us) server_negotiation.cc:299] Negotiation successful
0808 17:43:18.052754 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:43:18.052883 31884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:18.043435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:41315 (local address 127.9.187.195:57283)
0808 17:43:18.043591 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:18.043633 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:18.044087 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:18.044342 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:18.044345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:18.044509 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:18.044703 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:18.044708 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:18.045633 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:18.045634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:18.046817 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:18.046820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:18.047173 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:18.047175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:18.047300 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:18.047766 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:18.047776 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:18.049369 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:18.051258 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:18.051265 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:18.051267 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:18.051559 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:18.051797 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:18.051798 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:18.051798 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:18.051933 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:18.052360 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:18.052367 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:18.052525 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 17:43:18.052608 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 17:43:18.052721 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":74,"threads_started":1}
I20260808 17:43:18.053310 31882 heartbeater.cc:347] Connected to a master server at 127.9.187.254:41315
I20260808 17:43:18.053413 31882 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:18.053592 31882 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
I20260808 17:43:18.054230 31886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:18.046388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60268 (local address 127.9.187.254:41315)
0808 17:43:18.046490 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:18.046492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:18.046500 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:43:18.046594 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:18.046594 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:18.046604 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:18.046675 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:18.047581 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:18.048100 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:18.048835 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:18.049029 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:18.049078 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:18.050393 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:18.050395 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:18.050395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:18.050401 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:18.051878 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:18.052230 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:18.052232 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:18.052232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:18.052288 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:18.053104 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:18.053106 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:18.053106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:18.053247 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:18.053410 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:18.053957 (+ 547us) server_negotiation.cc:299] Negotiation successful
0808 17:43:18.054103 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":59,"threads_started":1}
W20260808 17:43:18.054366 31882 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:41315 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 17:43:18.054437 31882 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:18.054497 31882 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
I20260808 17:43:18.054824 31882 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:18.054903 31882 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
W20260808 17:43:18.055218 31882 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 17:43:18 dist-test-slave-bqcl krb5kdc[29340](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786210998, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:18.697285 31436 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:18.697525 31436 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
I20260808 17:43:18.698063 31075 ts_manager.cc:194] Registered new tserver with Master: dc3e69c8150f4c50b2ad0992bff5ac4b (127.9.187.193:37107)
I20260808 17:43:18.699520 31075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:38651
Aug 08 17:43:18 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210998, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
I20260808 17:43:18.884330 31672 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:18.884472 31672 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
I20260808 17:43:18.884723 31075 ts_manager.cc:194] Registered new tserver with Master: fdb2b1e49ba14d2ea142461a2d7bcd9c (127.9.187.194:45891)
I20260808 17:43:18.885260 31075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:49687
I20260808 17:43:19.055377 31882 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:19.055524 31882 heartbeater.cc:511] Master 127.9.187.254:41315 requested a full tablet report, sending...
I20260808 17:43:19.055787 31075 ts_manager.cc:194] Registered new tserver with Master: 752720562ef64676a3d00b955f7975ac (127.9.187.195:42781)
I20260808 17:43:19.056192 31075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:57283
I20260808 17:43:19.065730 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:43:19.072507 31920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.066645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60280 (local address 127.9.187.254:41315)
0808 17:43:19.066774 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:19.066775 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:19.066786 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:43:19.066861 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:19.066862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:19.066874 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:19.066930 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:19.067467 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.067957 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.068645 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.068848 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.068903 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.070055 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:19.070057 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:19.070057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:19.070065 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:19.071485 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:19.071799 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:19.071800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:19.071800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:19.071862 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:19.072026 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:19.072027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:19.072028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:19.072137 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:19.072228 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:19.072329 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 17:43:19.072410 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260808 17:43:19.074388 31075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60280:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:43:19.076031 31075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:43:19.084899 31931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.078609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:42781 (local address 127.0.0.1:50170)
0808 17:43:19.079028 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:19.079072 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:19.079134 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:19.080565 (+ 1431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:19.080566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:19.080570 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:19.080643 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:19.080645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.081962 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.081963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:19.083363 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:19.083366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.084583 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.084585 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:19.084675 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.084690 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 17:43:19.084760 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 17:43:19.084809 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":84,"threads_started":1}
I20260808 17:43:19.085156 31926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.078609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:45891 (local address 127.0.0.1:43718)
0808 17:43:19.080007 (+ 1398us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:19.080020 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:19.080107 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:19.080513 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:19.080517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:19.080520 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:19.080587 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:19.080590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.082182 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.082183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:19.083358 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:19.083361 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.084916 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.084917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:19.084981 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.084985 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:43:19.085037 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 17:43:19.085078 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1373,"mutex_wait_us":7,"thread_start_us":150,"threads_started":1}
I20260808 17:43:19.085477 31930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.078744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50170 (local address 127.9.187.195:42781)
0808 17:43:19.080265 (+ 1521us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:19.080270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:19.080283 (+ 13us) server_negotiation.cc:407] Connection header received
0808 17:43:19.080323 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:19.080325 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:19.080345 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:19.080437 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:19.080736 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.081832 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.083648 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.084398 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.084473 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.084544 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:19.085350 (+ 806us) server_negotiation.cc:299] Negotiation successful
0808 17:43:19.085396 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1482,"thread_start_us":69,"threads_started":1}
I20260808 17:43:19.085690 31932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.078892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43718 (local address 127.9.187.194:45891)
0808 17:43:19.079070 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:19.079075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:19.080116 (+ 1041us) server_negotiation.cc:407] Connection header received
0808 17:43:19.080187 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:19.080190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:19.080208 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:19.080292 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:19.080694 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.082062 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.083771 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.084740 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.084813 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.084874 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:19.085519 (+ 645us) server_negotiation.cc:299] Negotiation successful
0808 17:43:19.085561 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":56,"threads_started":1}
I20260808 17:43:19.086333 31785 tablet_service.cc:1467] Processing CreateTablet for tablet 23a98bc2738e42c787cb37976bbddded (DEFAULT_TABLE table=test-table [id=e0ac35aea2134441a6deea2d195bc02d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:19.086603 31533 tablet_service.cc:1467] Processing CreateTablet for tablet 23a98bc2738e42c787cb37976bbddded (DEFAULT_TABLE table=test-table [id=e0ac35aea2134441a6deea2d195bc02d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:19.086745 31785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23a98bc2738e42c787cb37976bbddded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:19.086987 31533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23a98bc2738e42c787cb37976bbddded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:19.091061 31935 tablet_bootstrap.cc:492] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac: Bootstrap starting.
I20260808 17:43:19.091871 31935 tablet_bootstrap.cc:654] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:19.092207 31935 log.cc:824] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:19.092574 31937 tablet_bootstrap.cc:492] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: Bootstrap starting.
I20260808 17:43:19.093263 31937 tablet_bootstrap.cc:654] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:19.093586 31937 log.cc:824] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:19.094410 31929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.078863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:37107 (local address 127.0.0.1:49842)
0808 17:43:19.083514 (+ 4651us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:19.083524 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:19.083574 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:19.090793 (+ 7219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:19.090794 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:19.090797 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:19.090842 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:19.090844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.092059 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.092060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:19.093084 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:19.093088 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.094157 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.094158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:19.094221 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.094226 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:43:19.094286 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 17:43:19.094330 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4619,"thread_start_us":69,"threads_started":1}
I20260808 17:43:19.094725 31937 tablet_bootstrap.cc:492] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: No bootstrap required, opened a new log
I20260808 17:43:19.094771 31935 tablet_bootstrap.cc:492] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac: No bootstrap required, opened a new log
I20260808 17:43:19.094798 31937 ts_tablet_manager.cc:1397] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:43:19.094830 31935 ts_tablet_manager.cc:1397] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 17:43:19.094853 31934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.078972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49842 (local address 127.9.187.193:37107)
0808 17:43:19.080086 (+ 1114us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:19.080091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:19.090167 (+ 10076us) server_negotiation.cc:407] Connection header received
0808 17:43:19.090216 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:19.090219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:19.090237 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:19.090336 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:19.090924 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.091924 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.093201 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.093940 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.094033 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.094095 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:19.094726 (+ 631us) server_negotiation.cc:299] Negotiation successful
0808 17:43:19.094773 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1078,"thread_start_us":72,"threads_started":1}
I20260808 17:43:19.095623 31310 tablet_service.cc:1467] Processing CreateTablet for tablet 23a98bc2738e42c787cb37976bbddded (DEFAULT_TABLE table=test-table [id=e0ac35aea2134441a6deea2d195bc02d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:19.095966 31310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23a98bc2738e42c787cb37976bbddded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:19.097016 31937 raft_consensus.cc:348] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45891 } } peers { permanent_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 37107 } } peers { permanent_uuid: "752720562ef64676a3d00b955f7975ac" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42781 } }
I20260808 17:43:19.097178 31937 raft_consensus.cc:374] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:19.097216 31937 raft_consensus.cc:729] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb2b1e49ba14d2ea142461a2d7bcd9c, State: Initialized, Role: FOLLOWER
I20260808 17:43:19.097208 31935 raft_consensus.cc:348] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45891 } } peers { permanent_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 37107 } } peers { permanent_uuid: "752720562ef64676a3d00b955f7975ac" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42781 } }
I20260808 17:43:19.097362 31935 raft_consensus.cc:374] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:19.097391 31935 raft_consensus.cc:729] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 752720562ef64676a3d00b955f7975ac, State: Initialized, Role: FOLLOWER
I20260808 17:43:19.097522 31935 consensus_queue.cc:260] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45891 } } peers { permanent_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 37107 } } peers { permanent_uuid: "752720562ef64676a3d00b955f7975ac" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42781 } }
I20260808 17:43:19.097684 31937 consensus_queue.cc:260] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45891 } } peers { permanent_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 37107 } } peers { permanent_uuid: "752720562ef64676a3d00b955f7975ac" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42781 } }
I20260808 17:43:19.097808 31935 ts_tablet_manager.cc:1428] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:43:19.097963 31882 heartbeater.cc:503] Master 127.9.187.254:41315 was elected leader, sending a full tablet report...
I20260808 17:43:19.098060 31937 ts_tablet_manager.cc:1428] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:43:19.098199 31672 heartbeater.cc:503] Master 127.9.187.254:41315 was elected leader, sending a full tablet report...
I20260808 17:43:19.099921 31942 tablet_bootstrap.cc:492] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b: Bootstrap starting.
I20260808 17:43:19.100610 31942 tablet_bootstrap.cc:654] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:19.100935 31942 log.cc:824] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:19.101753 31942 tablet_bootstrap.cc:492] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b: No bootstrap required, opened a new log
I20260808 17:43:19.101826 31942 ts_tablet_manager.cc:1397] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:43:19.104362 31942 raft_consensus.cc:348] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45891 } } peers { permanent_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 37107 } } peers { permanent_uuid: "752720562ef64676a3d00b955f7975ac" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42781 } }
I20260808 17:43:19.104525 31942 raft_consensus.cc:374] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:19.104560 31942 raft_consensus.cc:729] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3e69c8150f4c50b2ad0992bff5ac4b, State: Initialized, Role: FOLLOWER
I20260808 17:43:19.104736 31942 consensus_queue.cc:260] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45891 } } peers { permanent_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 37107 } } peers { permanent_uuid: "752720562ef64676a3d00b955f7975ac" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42781 } }
I20260808 17:43:19.104998 31942 ts_tablet_manager.cc:1428] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 17:43:19.105042 31436 heartbeater.cc:503] Master 127.9.187.254:41315 was elected leader, sending a full tablet report...
W20260808 17:43:19.114944 31673 tablet.cc:2369] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 17:43:19 dist-test-slave-bqcl krb5kdc[29340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786210998, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for HTTP/127.9.187.212@KRBTEST.COM
W20260808 17:43:19.181408 31438 tablet.cc:2369] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:43:19.188933 31940 raft_consensus.cc:482] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:43:19.189074 31940 raft_consensus.cc:504] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45891 } } peers { permanent_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 37107 } } peers { permanent_uuid: "752720562ef64676a3d00b955f7975ac" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42781 } }
I20260808 17:43:19.189523 31940 leader_election.cc:288] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdb2b1e49ba14d2ea142461a2d7bcd9c (127.9.187.194:45891), dc3e69c8150f4c50b2ad0992bff5ac4b (127.9.187.193:37107)
I20260808 17:43:19.193691 31932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.190005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:57721 (local address 127.9.187.194:45891)
0808 17:43:19.190071 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:19.190074 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:19.190273 (+ 199us) server_negotiation.cc:407] Connection header received
0808 17:43:19.190385 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:19.190386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:19.190396 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:19.190426 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:19.190680 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.191344 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.192763 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.193284 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.193332 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.193342 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:19.193577 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 17:43:19.193618 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:43:19.193737 31934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.190091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:33157 (local address 127.9.187.193:37107)
0808 17:43:19.190157 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:19.190160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:19.190289 (+ 129us) server_negotiation.cc:407] Connection header received
0808 17:43:19.190398 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:19.190399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:19.190409 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:19.190442 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:19.190686 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.191414 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.192784 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.193329 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.193380 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.193388 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:19.193618 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 17:43:19.193661 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:43:19.194013 31953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.189789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:37107 (local address 127.9.187.195:33157)
0808 17:43:19.190223 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:19.190234 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:19.190317 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:19.190513 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:19.190514 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:19.190516 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:19.190608 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:19.190610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.191526 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.191527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:19.192665 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:19.192668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.193451 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.193452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:19.193533 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.193537 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:43:19.193862 (+ 325us) client_negotiation.cc:240] Negotiation successful
0808 17:43:19.193906 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":2,"thread_start_us":98,"threads_started":1}
I20260808 17:43:19.194247 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.189688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:45891 (local address 127.9.187.195:57721)
0808 17:43:19.190208 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:19.190219 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:19.190306 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:19.190502 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:19.190503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:19.190505 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:19.190597 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:19.190600 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.191437 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.191437 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:19.192662 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:19.192666 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.193422 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.193423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:19.193493 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.193497 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:43:19.194069 (+ 572us) client_negotiation.cc:240] Negotiation successful
0808 17:43:19.194116 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"mutex_wait_us":35,"thread_start_us":122,"threads_started":1}
I20260808 17:43:19.194573 31339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23a98bc2738e42c787cb37976bbddded" candidate_uuid: "752720562ef64676a3d00b955f7975ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" is_pre_election: true
I20260808 17:43:19.194746 31339 raft_consensus.cc:2454] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 752720562ef64676a3d00b955f7975ac in term 0.
I20260808 17:43:19.194717 31589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23a98bc2738e42c787cb37976bbddded" candidate_uuid: "752720562ef64676a3d00b955f7975ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" is_pre_election: true
I20260808 17:43:19.194882 31589 raft_consensus.cc:2454] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 752720562ef64676a3d00b955f7975ac in term 0.
I20260808 17:43:19.195153 31715 leader_election.cc:302] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 752720562ef64676a3d00b955f7975ac, fdb2b1e49ba14d2ea142461a2d7bcd9c; no voters:
I20260808 17:43:19.195334 31940 raft_consensus.cc:2781] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:43:19.195385 31940 raft_consensus.cc:482] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:43:19.195406 31940 raft_consensus.cc:3037] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:19.196245 31940 raft_consensus.cc:504] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45891 } } peers { permanent_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 37107 } } peers { permanent_uuid: "752720562ef64676a3d00b955f7975ac" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42781 } }
I20260808 17:43:19.196369 31940 leader_election.cc:288] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [CANDIDATE]: Term 1 election: Requested vote from peers fdb2b1e49ba14d2ea142461a2d7bcd9c (127.9.187.194:45891), dc3e69c8150f4c50b2ad0992bff5ac4b (127.9.187.193:37107)
I20260808 17:43:19.196573 31589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23a98bc2738e42c787cb37976bbddded" candidate_uuid: "752720562ef64676a3d00b955f7975ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c"
I20260808 17:43:19.196646 31589 raft_consensus.cc:3037] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:19.197490 31589 raft_consensus.cc:2454] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 752720562ef64676a3d00b955f7975ac in term 1.
I20260808 17:43:19.197655 31715 leader_election.cc:302] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 752720562ef64676a3d00b955f7975ac, fdb2b1e49ba14d2ea142461a2d7bcd9c; no voters:
I20260808 17:43:19.197973 31339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23a98bc2738e42c787cb37976bbddded" candidate_uuid: "752720562ef64676a3d00b955f7975ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b"
I20260808 17:43:19.198048 31339 raft_consensus.cc:3037] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:19.198913 31339 raft_consensus.cc:2454] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 752720562ef64676a3d00b955f7975ac in term 1.
I20260808 17:43:19.199162 31940 raft_consensus.cc:2781] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:43:19.199332 31940 raft_consensus.cc:686] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 1 LEADER]: Becoming Leader. State: Replica: 752720562ef64676a3d00b955f7975ac, State: Running, Role: LEADER
I20260808 17:43:19.199424 31940 consensus_queue.cc:237] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45891 } } peers { permanent_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 37107 } } peers { permanent_uuid: "752720562ef64676a3d00b955f7975ac" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42781 } }
I20260808 17:43:19.200199 31075 catalog_manager.cc:5495] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 752720562ef64676a3d00b955f7975ac (127.9.187.195). New cstate: current_term: 1 leader_uuid: "752720562ef64676a3d00b955f7975ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "752720562ef64676a3d00b955f7975ac" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42781 } health_report { overall_health: HEALTHY } } }
I20260808 17:43:19.235049 31930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.229823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50172 (local address 127.9.187.195:42781)
0808 17:43:19.229891 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:19.229893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:19.230687 (+ 794us) server_negotiation.cc:407] Connection header received
0808 17:43:19.230733 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:19.230734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:19.230783 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:19.230872 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:43:19.231215 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.232053 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.233723 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:19.233984 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:19.234047 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:19.234341 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:43:19.234641 (+ 300us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:43:19.234729 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:19.234944 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 17:43:19.234967 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:43:19.237488 31339 raft_consensus.cc:1261] T 23a98bc2738e42c787cb37976bbddded P dc3e69c8150f4c50b2ad0992bff5ac4b [term 1 FOLLOWER]: Refusing update from remote peer 752720562ef64676a3d00b955f7975ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:43:19.237843 31589 raft_consensus.cc:1261] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c [term 1 FOLLOWER]: Refusing update from remote peer 752720562ef64676a3d00b955f7975ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:43:19.238446 31956 consensus_queue.cc:1035] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3e69c8150f4c50b2ad0992bff5ac4b" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:43:19.238632 31956 consensus_queue.cc:1035] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2b1e49ba14d2ea142461a2d7bcd9c" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:43:19.246337 31965 mvcc.cc:205] Tried to move back new op lower bound from 7316320252872912896 to 7316320252721401856. Current Snapshot: MvccSnapshot[applied={T|T < 7316320252872912896}]
I20260808 17:43:19.246567 31966 mvcc.cc:205] Tried to move back new op lower bound from 7316320252872912896 to 7316320252721401856. Current Snapshot: MvccSnapshot[applied={T|T < 7316320252872912896}]
I20260808 17:43:19.255263 31971 mvcc.cc:205] Tried to move back new op lower bound from 7316320252872912896 to 7316320252721401856. Current Snapshot: MvccSnapshot[applied={T|T < 7316320252872912896 or (T in {7316320252872912896})}]
I20260808 17:43:19.259375 31078 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:43:19.259490 31078 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:43:19.260428 31078 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1071c40a08b644b5b3f5731621d1849a: Sending DeleteTablet for 3 replicas of tablet 23a98bc2738e42c787cb37976bbddded
I20260808 17:43:19.260936 31533 tablet_service.cc:1514] Processing DeleteTablet for tablet 23a98bc2738e42c787cb37976bbddded with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:19 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:43718
I20260808 17:43:19.261193 31785 tablet_service.cc:1514] Processing DeleteTablet for tablet 23a98bc2738e42c787cb37976bbddded with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:19 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:50170
I20260808 17:43:19.261588 31310 tablet_service.cc:1514] Processing DeleteTablet for tablet 23a98bc2738e42c787cb37976bbddded with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:19 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:49842
I20260808 17:43:19.262318 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 31141
I20260808 17:43:19.270278 31979 tablet_replica.cc:330] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: stopping tablet replica
I20260808 17:43:19.270503 31979 raft_consensus.cc:2229] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:43:19.270746 31979 raft_consensus.cc:2258] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:43:19.272075 31979 ts_tablet_manager.cc:1905] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:43:19.272281 31980 tablet_replica.cc:330] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac: stopping tablet replica
I20260808 17:43:19.274247 31980 raft_consensus.cc:2229] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:43:19.274507 31980 raft_consensus.cc:2258] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:43:19.278833 31980 ts_tablet_manager.cc:1905] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:43:19.280647 31980 ts_tablet_manager.cc:1918] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:43:19.274115 31979 ts_tablet_manager.cc:1918] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:43:19.280885 31979 log.cc:1196] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/23a98bc2738e42c787cb37976bbddded
I20260808 17:43:19.281276 31979 ts_tablet_manager.cc:1939] T 23a98bc2738e42c787cb37976bbddded P fdb2b1e49ba14d2ea142461a2d7bcd9c: Deleting consensus metadata
I20260808 17:43:19.281876 31055 catalog_manager.cc:4841] TS fdb2b1e49ba14d2ea142461a2d7bcd9c (127.9.187.194:45891): tablet 23a98bc2738e42c787cb37976bbddded (table test-table [id=e0ac35aea2134441a6deea2d195bc02d]) successfully deleted
I20260808 17:43:19.282109 31980 log.cc:1196] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/23a98bc2738e42c787cb37976bbddded
I20260808 17:43:19.282536 31980 ts_tablet_manager.cc:1939] T 23a98bc2738e42c787cb37976bbddded P 752720562ef64676a3d00b955f7975ac: Deleting consensus metadata
I20260808 17:43:19.283072 31054 catalog_manager.cc:4841] TS 752720562ef64676a3d00b955f7975ac (127.9.187.195:42781): tablet 23a98bc2738e42c787cb37976bbddded (table test-table [id=e0ac35aea2134441a6deea2d195bc02d]) successfully deleted
W20260808 17:43:19.290434 31052 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:37107 (error 108)
I20260808 17:43:19.291390 31929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:19.291267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:37107 (local address 127.0.0.1:49844)
0808 17:43:19.291318 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:19.291351 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:37107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 17:43:19.291627 31052 catalog_manager.cc:4584] TS dc3e69c8150f4c50b2ad0992bff5ac4b (127.9.187.193:37107): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 23a98bc2738e42c787cb37976bbddded: Network error: Client connection negotiation failed: client connection to 127.9.187.193:37107: connect: Connection refused (error 111)
I20260808 17:43:19.291887 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 31442
I20260808 17:43:19.305966 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 31678
I20260808 17:43:19.321903 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 31023
I20260808 17:43:19.345285 9967 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 17:43:19.699003 9967 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 17:43:19.699091 9967 mini_ranger.cc:66] Stopping Ranger...
I20260808 17:43:20.042461 9967 mini_ranger.cc:68] Stopped Ranger
2026-08-08 17:43:20.042 UTC [29385] LOG: received smart shutdown request
2026-08-08 17:43:20.046 UTC [29385] LOG: background worker "logical replication launcher" (PID 29398) exited with exit code 1
2026-08-08 17:43:20.047 UTC [29392] LOG: shutting down
2026-08-08 17:43:20.173 UTC [29385] LOG: database system is shut down
2026-08-08T17:43:20Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (46534 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:43:20 dist-test-slave-bqcl krb5kdc[31999](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:43:20 dist-test-slave-bqcl krb5kdc[31999](info): set up 2 sockets
Aug 08 17:43:20 dist-test-slave-bqcl krb5kdc[31999](info): commencing operation
krb5kdc: starting...
W20260808 17:43:21.401682 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:43:21 dist-test-slave-bqcl krb5kdc[31999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:43:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:43:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:43:21.528928 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:38541
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:38541,127.9.187.253:45963,127.9.187.252:38173
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:21.652508 32023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:21.652809 32023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:21.652844 32023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:21.654543 32023 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:43:21.654605 32023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:21.654625 32023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:21.654652 32023 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:43:21.654676 32023 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:43:21.656930 32023 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:38541,127.9.187.253:45963,127.9.187.252:38173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:38541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:21.657220 32023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:21.657481 32023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:21.662621 32036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:21.662668 32041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:21.662770 32023 server_base.cc:1034] running on GCE node
W20260808 17:43:21.662878 32038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:21.663141 32023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:21.663420 32023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:21.664542 32023 hybrid_clock.cc:648] HybridClock initialized: now 1786211001664526 us; error 32 us; skew 500 ppm
Aug 08 17:43:21 dist-test-slave-bqcl krb5kdc[31999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:21.670912 32023 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:43:21.671474 32023 webserver.cc:460] Webserver started at http://127.9.187.254:42107/ using document root <none> and password file <none>
I20260808 17:43:21.671731 32023 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:21.671789 32023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:21.671914 32023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:21.673393 32023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "319202ec27a54e49a45bdd791817d12d"
format_stamp: "Formatted at 2026-08-08 17:43:21 on dist-test-slave-bqcl"
server_key: "b3472e0bf9bf289684c94612e578aa64"
server_key_iv: "e8350d79a80dcbc9e7b34de24f224748"
server_key_version: "encryptionkey@0"
I20260808 17:43:21.673825 32023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "319202ec27a54e49a45bdd791817d12d"
format_stamp: "Formatted at 2026-08-08 17:43:21 on dist-test-slave-bqcl"
server_key: "b3472e0bf9bf289684c94612e578aa64"
server_key_iv: "e8350d79a80dcbc9e7b34de24f224748"
server_key_version: "encryptionkey@0"
I20260808 17:43:21.675585 32023 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 17:43:21.676489 32050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:21.676707 32023 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:43:21.676800 32023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "319202ec27a54e49a45bdd791817d12d"
format_stamp: "Formatted at 2026-08-08 17:43:21 on dist-test-slave-bqcl"
server_key: "b3472e0bf9bf289684c94612e578aa64"
server_key_iv: "e8350d79a80dcbc9e7b34de24f224748"
server_key_version: "encryptionkey@0"
I20260808 17:43:21.676870 32023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:21.690841 32023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:21.693064 32023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:21.693230 32023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:21.698518 32023 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:38541
I20260808 17:43:21.698552 32142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:38541 every 8 connection(s)
I20260808 17:43:21.698972 32023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:43:21.699892 32146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:21.701416 32146 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:43:21.705148 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 32023
I20260808 17:43:21.705284 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:43:21.705459 9967 external_mini_cluster.cc:1428] Setting key 996d0421d39502bcaee36c38cf52804e
Aug 08 17:43:21 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:21.712927 32152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.702107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52312 (local address 127.9.187.254:38541)
0808 17:43:21.702309 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:21.702314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:21.702403 (+ 89us) server_negotiation.cc:407] Connection header received
0808 17:43:21.702910 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:21.702912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:21.702937 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:21.703050 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:21.703546 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.704879 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.706097 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.706544 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.706644 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:21.709163 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:21.709173 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:21.709173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:21.709181 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:21.711034 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:21.711504 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:21.711508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:21.711508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:21.711614 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:21.711872 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:21.711872 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:21.711873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:21.712185 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:21.712276 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:21.712495 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 17:43:21.712651 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":160,"thread_start_us":128,"threads_started":1}
I20260808 17:43:21.712934 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.702081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38541 (local address 127.0.0.1:52312)
0808 17:43:21.702258 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.702303 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:21.702767 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:21.703051 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:21.703053 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:21.703309 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:21.703463 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:21.703468 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.704980 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.704981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:21.706006 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:21.706009 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.706655 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.706656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:21.706751 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:21.707310 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:21.707321 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:21.709066 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:21.711132 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:21.711141 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:21.711144 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:21.711409 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:21.711687 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:21.711687 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:21.711688 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:21.711802 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:21.712264 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:21.712273 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:21.712355 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 17:43:21.712463 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 17:43:21.712725 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":110,"thread_start_us":98,"threads_started":1}
I20260808 17:43:21.713701 32146 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:43:21.714182 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.713932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45963 (local address 127.0.0.1:36864)
0808 17:43:21.714069 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.714153 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
W20260808 17:43:21.714335 32055 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45963: connect: Connection refused (error 111)
I20260808 17:43:21.714727 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.714653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45963 (local address 127.0.0.1:36866)
0808 17:43:21.714683 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.714703 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.9.187.253@KRBTEST.COM; defaulting to no policy
W20260808 17:43:21.714839 32146 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.253:45963: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45963: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab.
Entry for principal kudu/127.9.187.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab.
I20260808 17:43:21.735459 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.253:45963
--webserver_interface=127.9.187.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab
--principal=kudu/127.9.187.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:38541,127.9.187.253:45963,127.9.187.252:38173
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:43:21.764050 32146 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } attempt: 1
I20260808 17:43:21.764595 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.764455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45963 (local address 127.0.0.1:36876)
0808 17:43:21.764515 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.764561 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 17:43:21.764945 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.764862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45963 (local address 127.0.0.1:36888)
0808 17:43:21.764900 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.764926 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 17:43:21.765048 32146 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.253:45963: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45963: connect: Connection refused (error 111)
W20260808 17:43:21.816636 32159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:21.816843 32159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:21.816872 32159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:21.817968 32159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:43:21.818007 32159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:21.818027 32159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:21.818042 32159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:43:21.818058 32159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:43:21.819535 32159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:38541,127.9.187.253:45963,127.9.187.252:38173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab
--principal=kudu/127.9.187.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.253:45963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.187.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:21.819772 32159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:21.819981 32159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:43:21.824539 32159 server_base.cc:1034] running on GCE node
W20260808 17:43:21.824523 32172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:21.824519 32169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:21.824498 32180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:21.824998 32159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:21.825291 32159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:21.826427 32159 hybrid_clock.cc:648] HybridClock initialized: now 1786211001826415 us; error 29 us; skew 500 ppm
Aug 08 17:43:21 dist-test-slave-bqcl krb5kdc[31999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:21.828752 32159 init.cc:377] Logged in from keytab as kudu/127.9.187.253@KRBTEST.COM (short username kudu)
I20260808 17:43:21.829167 32159 webserver.cc:460] Webserver started at http://127.9.187.253:46719/ using document root <none> and password file <none>
I20260808 17:43:21.829341 32159 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:21.829378 32159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:21.829468 32159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:21.830523 32159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/data/instance:
uuid: "7443a63c58824f3fb409b3eadd4935b0"
format_stamp: "Formatted at 2026-08-08 17:43:21 on dist-test-slave-bqcl"
server_key: "3846effb7e1129cb2383f8f4949b11ae"
server_key_iv: "20cbfafb521c581e43fd1d7357bc4bc2"
server_key_version: "encryptionkey@0"
I20260808 17:43:21.830920 32159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/wal/instance:
uuid: "7443a63c58824f3fb409b3eadd4935b0"
format_stamp: "Formatted at 2026-08-08 17:43:21 on dist-test-slave-bqcl"
server_key: "3846effb7e1129cb2383f8f4949b11ae"
server_key_iv: "20cbfafb521c581e43fd1d7357bc4bc2"
server_key_version: "encryptionkey@0"
I20260808 17:43:21.832231 32159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:43:21.832943 32189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:21.833127 32159 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:21.833189 32146 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } attempt: 2
I20260808 17:43:21.833231 32159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/wal
uuid: "7443a63c58824f3fb409b3eadd4935b0"
format_stamp: "Formatted at 2026-08-08 17:43:21 on dist-test-slave-bqcl"
server_key: "3846effb7e1129cb2383f8f4949b11ae"
server_key_iv: "20cbfafb521c581e43fd1d7357bc4bc2"
server_key_version: "encryptionkey@0"
I20260808 17:43:21.833297 32159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:21.833582 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.833451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45963 (local address 127.0.0.1:36892)
0808 17:43:21.833502 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.833544 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 17:43:21.833899 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.833799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45963 (local address 127.0.0.1:36908)
0808 17:43:21.833843 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.833874 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 17:43:21.833995 32146 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.253:45963: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45963: connect: Connection refused (error 111)
I20260808 17:43:21.851016 32159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:21.853184 32159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:21.853340 32159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:21.857481 32159 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.253:45963
I20260808 17:43:21.857532 32270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.253:45963 every 8 connection(s)
I20260808 17:43:21.857848 32159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
I20260808 17:43:21.858758 32273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:21.860414 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 32159
I20260808 17:43:21.860308 32273 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:43:21.860522 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-1/wal/instance
I20260808 17:43:21.860728 9967 external_mini_cluster.cc:1428] Setting key 126cc5d1543b03e109a9d2debeb13b84
Aug 08 17:43:21 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:21.869169 32152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.860956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52324 (local address 127.9.187.254:38541)
0808 17:43:21.861030 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:21.861032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:21.861232 (+ 200us) server_negotiation.cc:407] Connection header received
0808 17:43:21.861657 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:21.861658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:21.861671 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:21.861760 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:21.862361 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.862864 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.863810 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.864030 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.864087 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:21.866487 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:21.866488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:21.866489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:21.866496 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:21.867751 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:21.868252 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:21.868252 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:21.868253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:21.868297 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:21.868557 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:21.868558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:21.868558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:21.868651 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:21.868707 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:21.869040 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 17:43:21.869105 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:43:21.869431 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.860951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38541 (local address 127.0.0.1:52324)
0808 17:43:21.861100 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.861140 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:21.861571 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:21.861811 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:21.861814 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:21.862040 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:21.862273 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:21.862278 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.862948 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.862949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:21.863729 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:21.863732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.864101 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.864102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:21.864226 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:21.864722 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:21.864730 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:21.866388 (+ 1658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:21.867835 (+ 1447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:21.867843 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:21.867846 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:21.868167 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:21.868352 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:21.868353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:21.868353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:21.868485 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:21.868712 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:21.868719 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:21.868884 (+ 165us) client_negotiation.cc:769] Sending connection context
0808 17:43:21.869033 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 17:43:21.869207 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":75,"threads_started":1}
WARNING: no policy specified for kudu/127.9.187.252@KRBTEST.COM; defaulting to no policy
I20260808 17:43:21.870034 32273 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.252@KRBTEST.COM" created.
Aug 08 17:43:21 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
I20260808 17:43:21.876929 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.870282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45963 (local address 127.0.0.1:36918)
0808 17:43:21.870322 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.870335 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:21.870384 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:21.870624 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:21.870625 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:21.870753 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:21.870802 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:21.870803 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.871594 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.871595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:21.872108 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:21.872110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.872680 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.872681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:21.872758 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:21.873126 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:21.873131 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:21.874315 (+ 1184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:21.875927 (+ 1612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:21.875928 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:21.875929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:21.876108 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:21.876296 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:21.876296 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:21.876297 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:21.876355 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:21.876613 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:21.876613 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:21.876652 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 17:43:21.876721 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 17:43:21.876821 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260808 17:43:21.877027 32278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.870362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36918 (local address 127.9.187.253:45963)
0808 17:43:21.870503 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:21.870506 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:21.870521 (+ 15us) server_negotiation.cc:407] Connection header received
0808 17:43:21.870538 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:21.870540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:21.870550 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:21.870613 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:21.870868 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.871526 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.872226 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.872600 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.872661 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:21.874391 (+ 1730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:21.874400 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:21.874400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:21.874407 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:21.875844 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:21.876179 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:21.876182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:21.876182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:21.876238 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:21.876410 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:21.876411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:21.876411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:21.876548 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:21.876626 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:21.876759 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 17:43:21.876879 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
I20260808 17:43:21.877563 32273 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:43:21.877876 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.877762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56444)
0808 17:43:21.877806 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.877853 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:43:21.878000 32193 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
I20260808 17:43:21.878412 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.878321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56460)
0808 17:43:21.878359 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.878386 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 17:43:21.878521 32273 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:38173: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab.
Entry for principal kudu/127.9.187.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab.
I20260808 17:43:21.886679 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.252:38173
--webserver_interface=127.9.187.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab
--principal=kudu/127.9.187.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:38541,127.9.187.253:45963,127.9.187.252:38173
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:43:21.925159 32146 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } attempt: 3
I20260808 17:43:21.927750 32273 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } attempt: 1
I20260808 17:43:21.928125 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.928007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56464)
0808 17:43:21.928056 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.928087 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 17:43:21.928702 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.928597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56478)
0808 17:43:21.928632 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.928668 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260808 17:43:21.929267 32273 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:38173: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Aug 08 17:43:21 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
I20260808 17:43:21.932394 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.925601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45963 (local address 127.0.0.1:36920)
0808 17:43:21.925666 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.925678 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:21.925746 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:21.925879 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:21.925880 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:21.926041 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:21.926106 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:21.926108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.927117 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.927118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:21.927645 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:21.927647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.928145 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.928146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:21.928236 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:21.928722 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:21.928727 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:21.929971 (+ 1244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:21.931567 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:21.931567 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:21.931568 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:21.931742 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:21.931919 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:21.931920 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:21.931920 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:21.931966 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:21.932181 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:21.932182 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:21.932217 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 17:43:21.932262 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:43:21.932332 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 17:43:21.932453 32278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.925624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36920 (local address 127.9.187.253:45963)
0808 17:43:21.925670 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:21.925672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:21.925734 (+ 62us) server_negotiation.cc:407] Connection header received
0808 17:43:21.925804 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:21.925805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:21.925818 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:21.925868 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:21.926228 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.927039 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.927734 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:21.928060 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:21.928131 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:21.930047 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:21.930048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:21.930049 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:21.930056 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:21.931484 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:21.931802 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:21.931803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:21.931804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:21.931863 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:21.932010 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:21.932011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:21.932011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:21.932133 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:21.932192 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:21.932300 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 17:43:21.932375 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:43:21.932899 32146 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:43:21.933208 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.933127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56484)
0808 17:43:21.933160 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.933187 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 17:43:21.933499 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.933420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56500)
0808 17:43:21.933459 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.933481 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 17:43:21.933580 32146 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:38173: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
I20260808 17:43:21.964715 32146 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } attempt: 1
I20260808 17:43:21.965114 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.965001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56516)
0808 17:43:21.965049 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.965079 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 17:43:21.965507 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.965368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56532)
0808 17:43:21.965429 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.965475 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 17:43:21.965617 32146 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:38173: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
W20260808 17:43:21.969585 32283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:21.969774 32283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:21.969797 32283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:21.970949 32283 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:43:21.970996 32283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:21.971014 32283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:21.971042 32283 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:43:21.971068 32283 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:43:21.972580 32283 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:38541,127.9.187.253:45963,127.9.187.252:38173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab
--principal=kudu/127.9.187.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.252:38173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.187.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:21.972815 32283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:21.973035 32283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:21.977592 32294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:21.977567 32291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:21.977622 32289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:21.977754 32283 server_base.cc:1034] running on GCE node
I20260808 17:43:21.978008 32283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:21.978335 32283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:21.979477 32283 hybrid_clock.cc:648] HybridClock initialized: now 1786211001979464 us; error 26 us; skew 500 ppm
Aug 08 17:43:21 dist-test-slave-bqcl krb5kdc[31999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:21.981878 32283 init.cc:377] Logged in from keytab as kudu/127.9.187.252@KRBTEST.COM (short username kudu)
I20260808 17:43:21.982333 32283 webserver.cc:460] Webserver started at http://127.9.187.252:36621/ using document root <none> and password file <none>
I20260808 17:43:21.982533 32283 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:21.982573 32283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:21.982672 32283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:21.983637 32283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/data/instance:
uuid: "9bcbc42a275e4b2683a65da311308e4b"
format_stamp: "Formatted at 2026-08-08 17:43:21 on dist-test-slave-bqcl"
server_key: "e0bdbe9462b9d005fe1e5b34e0903409"
server_key_iv: "0a937484e98814d8718bf9eb5da9f7f4"
server_key_version: "encryptionkey@0"
I20260808 17:43:21.983925 32283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/wal/instance:
uuid: "9bcbc42a275e4b2683a65da311308e4b"
format_stamp: "Formatted at 2026-08-08 17:43:21 on dist-test-slave-bqcl"
server_key: "e0bdbe9462b9d005fe1e5b34e0903409"
server_key_iv: "0a937484e98814d8718bf9eb5da9f7f4"
server_key_version: "encryptionkey@0"
I20260808 17:43:21.985067 32283 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:43:21.985718 32308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:21.985858 32283 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:43:21.985939 32283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/wal
uuid: "9bcbc42a275e4b2683a65da311308e4b"
format_stamp: "Formatted at 2026-08-08 17:43:21 on dist-test-slave-bqcl"
server_key: "e0bdbe9462b9d005fe1e5b34e0903409"
server_key_iv: "0a937484e98814d8718bf9eb5da9f7f4"
server_key_version: "encryptionkey@0"
I20260808 17:43:21.986006 32283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:21.997407 32273 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } attempt: 2
I20260808 17:43:21.997798 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.997675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56548)
0808 17:43:21.997742 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.997770 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 17:43:21.998145 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:21.998041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56560)
0808 17:43:21.998082 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:21.998106 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 17:43:21.998234 32273 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:38173: Network error: Client connection negotiation failed: client connection to 127.9.187.252:38173: connect: Connection refused (error 111)
I20260808 17:43:22.002234 32283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:22.004321 32283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:22.004453 32283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:22.008073 32283 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.252:38173
I20260808 17:43:22.008113 32388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.252:38173 every 8 connection(s)
I20260808 17:43:22.008430 32283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
I20260808 17:43:22.009248 32389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:22.010805 32389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:43:22.011130 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 32283
I20260808 17:43:22.011245 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786210848752357-9967-0/minicluster-data/master-2/wal/instance
I20260808 17:43:22.011446 9967 external_mini_cluster.cc:1428] Setting key ca9794be4893fa2fd434711ecaba1e23
Aug 08 17:43:22 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
Aug 08 17:43:22 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
I20260808 17:43:22.020718 32152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.011461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52330 (local address 127.9.187.254:38541)
0808 17:43:22.011503 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:22.011505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:22.011773 (+ 268us) server_negotiation.cc:407] Connection header received
0808 17:43:22.012291 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:22.012293 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:22.012304 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:22.012351 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:22.013002 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.013753 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.014902 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.015171 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.015233 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.017438 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:22.017440 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:22.017441 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:22.017447 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:22.019445 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.019856 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.019857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.019857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.019912 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.020125 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.020126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.020127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.020252 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:22.020323 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:22.020534 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 17:43:22.020619 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:43:22.020900 32396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.011819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56570 (local address 127.9.187.252:38173)
0808 17:43:22.011967 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:22.011972 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:22.012035 (+ 63us) server_negotiation.cc:407] Connection header received
0808 17:43:22.012196 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:22.012202 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:22.012221 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:22.012301 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:22.013006 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.014074 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.015019 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.015410 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.015459 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.017890 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:22.017899 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:22.017900 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:22.017907 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:22.019578 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.019928 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.019931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.019931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.020024 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.020208 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.020209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.020209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.020434 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:22.020570 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:22.020639 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 17:43:22.020709 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":67,"threads_started":1}
I20260808 17:43:22.020898 32392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.011462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38541 (local address 127.0.0.1:52330)
0808 17:43:22.011632 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:22.011679 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:22.012198 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:22.012385 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:22.012388 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:22.012700 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:22.012923 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:22.012928 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.013831 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.013831 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:22.014824 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:22.014827 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.015253 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.015253 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:22.015351 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.015751 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:22.015761 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:22.017353 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:22.019532 (+ 2179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:22.019539 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:22.019540 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:22.019786 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:22.019973 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:22.019974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:22.019974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:22.020061 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:22.020316 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:22.020321 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:22.020420 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 17:43:22.020501 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 17:43:22.020654 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":78,"threads_started":1}
I20260808 17:43:22.021355 32389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:43:22 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
Aug 08 17:43:22 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:22.027881 32392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.021582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45963 (local address 127.0.0.1:36930)
0808 17:43:22.021689 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:22.021700 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:22.021744 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:22.021911 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:22.021912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:22.022014 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:22.022057 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:22.022058 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.022666 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.022667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:22.023128 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:22.023129 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.023447 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.023447 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:22.023514 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.023835 (+ 321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:22.023840 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:22.024940 (+ 1100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:22.027015 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:22.027015 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:22.027016 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:22.027166 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:22.027343 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:22.027343 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:22.027344 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:22.027389 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:22.027600 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:22.027600 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:22.027639 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 17:43:22.027706 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:43:22.027792 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 17:43:22.027894 32152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.021781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52334 (local address 127.9.187.254:38541)
0808 17:43:22.021818 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:22.021819 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:22.021840 (+ 21us) server_negotiation.cc:407] Connection header received
0808 17:43:22.021858 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:22.021859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:22.021867 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:22.021908 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:22.022371 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.022808 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.023415 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.023588 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.023645 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.025585 (+ 1940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:22.025586 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:22.025586 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:22.025592 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:22.026895 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.027212 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.027213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.027214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.027268 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.027444 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.027445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.027445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.027544 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:22.027709 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:22.027746 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 17:43:22.027810 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:43:22.027905 32278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.021635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36930 (local address 127.9.187.253:45963)
0808 17:43:22.021689 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:22.021691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:22.021733 (+ 42us) server_negotiation.cc:407] Connection header received
0808 17:43:22.021825 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:22.021826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:22.021835 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:22.021861 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:22.022148 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.022599 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.023201 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.023392 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.023443 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.025018 (+ 1575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:22.025019 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:22.025020 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:22.025026 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:22.026935 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.027233 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.027233 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.027234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.027283 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.027442 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.027442 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.027442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.027543 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:22.027600 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:22.027750 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 17:43:22.027822 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:43:22.028623 32389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:43:22 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
Aug 08 17:43:22 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
I20260808 17:43:22.034566 32392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.028841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56578)
0808 17:43:22.028868 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:22.028876 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:22.028905 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:22.029012 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:22.029012 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:22.029131 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:22.029159 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:22.029161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.029809 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.029809 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:22.030358 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:22.030361 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.030716 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.030717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:22.030752 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.031081 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:22.031084 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:22.032234 (+ 1150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:22.033671 (+ 1437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:22.033672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:22.033673 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:22.033828 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:22.033989 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:22.033990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:22.033990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:22.034041 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:22.034266 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:22.034266 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:22.034302 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 17:43:22.034363 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 17:43:22.034453 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15}
I20260808 17:43:22.034623 32396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.028873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56578 (local address 127.9.187.252:38173)
0808 17:43:22.028906 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:22.028907 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:22.028932 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:43:22.028949 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:22.028950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:22.028959 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:22.029008 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:22.029223 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.029735 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.030431 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.030652 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.031083 (+ 431us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.032310 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:22.032311 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:22.032311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:22.032317 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:22.033600 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.033887 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.033888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.033888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.033938 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.034090 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.034091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.034091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.034213 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:22.034266 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:22.034388 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 17:43:22.034500 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":17}
I20260808 17:43:22.035163 32278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.028446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36936 (local address 127.9.187.253:45963)
0808 17:43:22.028481 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:22.028482 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:22.028489 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:43:22.028528 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:22.028529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:22.028538 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:22.028591 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:22.029100 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.029575 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.030259 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.030512 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.030558 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.032816 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:22.032817 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:22.032817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:22.032824 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:22.034023 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.034347 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.034347 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.034348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.034397 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.034557 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.034557 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.034558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.034664 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:22.034846 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:22.035006 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 17:43:22.035078 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:43:22.036003 32389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b: Bootstrap starting.
I20260808 17:43:22.036507 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:43:22.036914 32389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:22.037182 32389 log.cc:824] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:22.037871 32389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b: No bootstrap required, opened a new log
I20260808 17:43:22.039623 32389 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } }
I20260808 17:43:22.039727 32389 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:22.039747 32389 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bcbc42a275e4b2683a65da311308e4b, State: Initialized, Role: FOLLOWER
I20260808 17:43:22.039837 32389 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } }
I20260808 17:43:22.040105 32389 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:43:22.040062 32413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } } }
I20260808 17:43:22.040159 32413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:43:22.040748 32146 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } attempt: 2
W20260808 17:43:22.041874 32429 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 17:43:22.044698 32278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.037944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36940 (local address 127.9.187.253:45963)
0808 17:43:22.037976 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:22.037977 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:22.037985 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:43:22.038002 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:22.038003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:22.038011 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:22.038061 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:22.038815 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.039235 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.040102 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.040380 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.040408 (+ 28us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.041812 (+ 1404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:22.041813 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:22.041813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:22.041820 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:22.043334 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.043711 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.043712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.043712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.043770 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.043967 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.043968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.043968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.044081 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:22.044170 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:22.044549 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 17:43:22.044619 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:43:22.042443 32283 master_runner.cc:186] Error getting master registration for 127.9.187.254:38541: OK, instance_id { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" instance_seqno: 1786211001697040 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:43:22.044837 32283 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 17:43:22.044884 32429 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:43:22.045580 32152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.037905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52342 (local address 127.9.187.254:38541)
0808 17:43:22.038103 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:22.038105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:22.038113 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:43:22.038205 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:22.038206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:22.038215 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:22.038267 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:22.038796 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.039451 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.040321 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.040593 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.040943 (+ 350us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.042900 (+ 1957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:22.042901 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:22.042901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:22.042907 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:22.044436 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.044803 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.044804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.044804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.044859 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.045041 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.045041 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.045042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.045162 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:22.045237 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:22.045418 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 17:43:22.045494 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179}
Aug 08 17:43:22 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
I20260808 17:43:22.050943 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.040946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56606)
0808 17:43:22.041023 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:22.041033 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:22.041068 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:22.042044 (+ 976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:22.042045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:22.044643 (+ 2598us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:22.044693 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:22.044695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.045605 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.045616 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:22.046165 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:22.046167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.046553 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.046553 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:22.046585 (+ 32us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.046946 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:22.046950 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:22.048258 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:22.049868 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:22.049869 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:22.049869 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:22.050072 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:22.050314 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:22.050315 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:22.050315 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:22.050385 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:22.050654 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:22.050655 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:22.050701 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 17:43:22.050758 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 17:43:22.050845 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 17:43:22.050946 32396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.041142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56606 (local address 127.9.187.252:38173)
0808 17:43:22.041728 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:22.041730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:22.041739 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:43:22.041959 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:22.041960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:22.041969 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:22.042015 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:22.044760 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.045375 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.046218 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.046485 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.046558 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.048336 (+ 1778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:22.048337 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:22.048337 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:22.048343 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:22.049770 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.050176 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.050186 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.050186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.050244 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.050458 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.050459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.050459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.050582 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:22.050647 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:22.050799 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 17:43:22.050861 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":86,"threads_started":1}
I20260808 17:43:22.051734 32425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.038038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56594 (local address 127.9.187.252:38173)
0808 17:43:22.041335 (+ 3297us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:22.041337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:22.042145 (+ 808us) server_negotiation.cc:407] Connection header received
0808 17:43:22.042236 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:22.042236 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:22.042246 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:22.042293 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:22.042902 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.044497 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.047332 (+ 2835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.047617 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.047658 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.048982 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:22.048983 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:22.048983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:22.048990 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:22.050423 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.050720 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.050721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.050721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.050789 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.050998 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.050999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.050999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.051111 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:22.051205 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:22.051565 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 17:43:22.051642 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3279}
I20260808 17:43:22.052394 32146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d: Bootstrap starting.
I20260808 17:43:22.052989 32146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:22.053252 32146 log.cc:824] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:22.054117 32146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d: No bootstrap required, opened a new log
I20260808 17:43:22.055719 32146 raft_consensus.cc:348] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } }
I20260808 17:43:22.055823 32146 raft_consensus.cc:374] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:22.055855 32146 raft_consensus.cc:729] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 319202ec27a54e49a45bdd791817d12d, State: Initialized, Role: FOLLOWER
I20260808 17:43:22.055965 32146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } }
I20260808 17:43:22.056213 32436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } } }
I20260808 17:43:22.056262 32146 sys_catalog.cc:564] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:43:22.056303 32436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [sys.catalog]: This master's current role is: FOLLOWER
W20260808 17:43:22.058171 32453 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:43:22.058274 32453 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:43:22.058669 32023 master_runner.cc:186] Error getting master registration for 127.9.187.253:45963: OK, instance_id { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" instance_seqno: 1786211001856345 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:43:22.060855 32023 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:43:22.089324 32273 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } attempt: 3
Aug 08 17:43:22 dist-test-slave-bqcl krb5kdc[31999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211001, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
I20260808 17:43:22.097740 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.089645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:38173 (local address 127.0.0.1:56610)
0808 17:43:22.089698 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:22.089709 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:22.089746 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:22.089888 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:22.089889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:22.090086 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:22.090169 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:22.090171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.091127 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.091128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:22.091979 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:22.091982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.092669 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.092670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:22.092745 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.093242 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:22.093247 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:22.094866 (+ 1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:22.096671 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:22.096672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:22.096673 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:22.096896 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:22.097098 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:22.097098 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:22.097099 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:22.097166 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:22.097412 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:22.097413 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:22.097461 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 17:43:22.097528 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:43:22.097633 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 17:43:22.097739 32425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:22.089691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56610 (local address 127.9.187.252:38173)
0808 17:43:22.089731 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:22.089732 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:22.089742 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:43:22.089795 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:22.089796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:22.089815 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:22.089874 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:22.090242 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.091051 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.092239 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:22.092579 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:22.092656 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:22.094952 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:22.094954 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:22.094954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:22.094962 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:22.096585 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.096966 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.096967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.096968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.097035 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:22.097223 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:22.097224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:22.097224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:22.097352 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:22.097415 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:22.097558 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 17:43:22.097645 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:43:22.099751 32273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0: Bootstrap starting.
I20260808 17:43:22.100497 32273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:22.100809 32273 log.cc:824] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:22.101795 32273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0: No bootstrap required, opened a new log
I20260808 17:43:22.103765 32273 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } }
I20260808 17:43:22.103919 32273 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:22.103956 32273 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7443a63c58824f3fb409b3eadd4935b0, State: Initialized, Role: FOLLOWER
I20260808 17:43:22.104079 32273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } }
I20260808 17:43:22.104406 32273 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 17:43:22.106292 32471 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:43:22.106395 32471 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:43:22.108371 32159 master_runner.cc:263] No leader master found from master 7443a63c58824f3fb409b3eadd4935b0
I20260808 17:43:22.108430 32159 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:43:22.104362 32456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } } }
I20260808 17:43:22.108506 32456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:43:22.127768 32456 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:43:22.127871 32456 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } }
I20260808 17:43:22.128286 32097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7443a63c58824f3fb409b3eadd4935b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "319202ec27a54e49a45bdd791817d12d" is_pre_election: true
I20260808 17:43:22.128432 32097 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7443a63c58824f3fb409b3eadd4935b0 in term 0.
I20260808 17:43:22.128628 32193 leader_election.cc:302] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 319202ec27a54e49a45bdd791817d12d, 7443a63c58824f3fb409b3eadd4935b0; no voters:
I20260808 17:43:22.129050 32348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7443a63c58824f3fb409b3eadd4935b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bcbc42a275e4b2683a65da311308e4b" is_pre_election: true
I20260808 17:43:22.129206 32348 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7443a63c58824f3fb409b3eadd4935b0 in term 0.
I20260808 17:43:22.129387 32456 leader_election.cc:288] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 319202ec27a54e49a45bdd791817d12d (127.9.187.254:38541), 9bcbc42a275e4b2683a65da311308e4b (127.9.187.252:38173)
I20260808 17:43:22.129496 32456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:43:22.129549 32456 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:43:22.129575 32456 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:22.130522 32456 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } }
I20260808 17:43:22.130764 32097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7443a63c58824f3fb409b3eadd4935b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "319202ec27a54e49a45bdd791817d12d"
I20260808 17:43:22.130847 32097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:22.131707 32097 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7443a63c58824f3fb409b3eadd4935b0 in term 1.
I20260808 17:43:22.131875 32193 leader_election.cc:302] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 319202ec27a54e49a45bdd791817d12d, 7443a63c58824f3fb409b3eadd4935b0; no voters:
I20260808 17:43:22.132073 32348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7443a63c58824f3fb409b3eadd4935b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bcbc42a275e4b2683a65da311308e4b"
I20260808 17:43:22.132175 32348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:22.133006 32348 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7443a63c58824f3fb409b3eadd4935b0 in term 1.
I20260808 17:43:22.133198 32456 leader_election.cc:288] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [CANDIDATE]: Term 1 election: Requested vote from peers 319202ec27a54e49a45bdd791817d12d (127.9.187.254:38541), 9bcbc42a275e4b2683a65da311308e4b (127.9.187.252:38173)
I20260808 17:43:22.133265 32456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:43:22.133308 32456 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [term 1 LEADER]: Becoming Leader. State: Replica: 7443a63c58824f3fb409b3eadd4935b0, State: Running, Role: LEADER
I20260808 17:43:22.133390 32456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } }
I20260808 17:43:22.133852 32456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7443a63c58824f3fb409b3eadd4935b0. Latest consensus state: current_term: 1 leader_uuid: "7443a63c58824f3fb409b3eadd4935b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } } }
I20260808 17:43:22.133937 32456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:22.134148 32477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:43:22.134347 32477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:43:22.136343 32348 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [term 1 FOLLOWER]: Refusing update from remote peer 7443a63c58824f3fb409b3eadd4935b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:43:22.136652 32456 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:43:22.138867 32413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7443a63c58824f3fb409b3eadd4935b0. Latest consensus state: current_term: 1 leader_uuid: "7443a63c58824f3fb409b3eadd4935b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } } }
I20260808 17:43:22.138962 32413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:43:22.139557 32097 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [term 1 FOLLOWER]: Refusing update from remote peer 7443a63c58824f3fb409b3eadd4935b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:43:22.139850 32456 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:43:22.141094 32436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7443a63c58824f3fb409b3eadd4935b0. Latest consensus state: current_term: 1 leader_uuid: "7443a63c58824f3fb409b3eadd4935b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } } }
I20260808 17:43:22.141216 32436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:43:22.142195 32474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7443a63c58824f3fb409b3eadd4935b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } } }
I20260808 17:43:22.142298 32474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:22.142602 32436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7443a63c58824f3fb409b3eadd4935b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } } }
I20260808 17:43:22.142683 32436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:43:22.142920 32478 mvcc.cc:205] Tried to move back new op lower bound from 7316320264748249088 to 7316320264739217408. Current Snapshot: MvccSnapshot[applied={T|T < 7316320264748249088}]
I20260808 17:43:22.143666 32456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7443a63c58824f3fb409b3eadd4935b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } } }
I20260808 17:43:22.143748 32456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:22.144019 32413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7443a63c58824f3fb409b3eadd4935b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "319202ec27a54e49a45bdd791817d12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38541 } } peers { permanent_uuid: "7443a63c58824f3fb409b3eadd4935b0" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45963 } } peers { permanent_uuid: "9bcbc42a275e4b2683a65da311308e4b" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 38173 } } }
I20260808 17:43:22.144099 32413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:43:22.144686 32479 mvcc.cc:205] Tried to move back new op lower bound from 7316320264748249088 to 7316320264739217408. Current Snapshot: MvccSnapshot[applied={T|T < 7316320264748249088}]
I20260808 17:43:22.145427 32486 mvcc.cc:205] Tried to move back new op lower bound from 7316320264748249088 to 7316320264739217408. Current Snapshot: MvccSnapshot[applied={T|T < 7316320264748249088}]
I20260808 17:43:22.145629 32477 catalog_manager.cc:1347] Generated new cluster ID: dd365eb91b794f9ea0a8d6f02f191049
I20260808 17:43:22.145706 32477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:43:22.159588 32477 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:43:22.160331 32477 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:43:22.165934 32477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7443a63c58824f3fb409b3eadd4935b0: Generated new TSK 0
I20260808 17:43:22.166105 32477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:43:23.045305 32429 catalog_manager.cc:1259] Loaded cluster ID: dd365eb91b794f9ea0a8d6f02f191049
I20260808 17:43:23.045378 32429 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b: loading cluster ID for follower catalog manager: success
I20260808 17:43:23.046244 32429 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b: acquiring CA information for follower catalog manager: success
I20260808 17:43:23.046555 32429 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9bcbc42a275e4b2683a65da311308e4b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:43:23.058866 32453 catalog_manager.cc:1259] Loaded cluster ID: dd365eb91b794f9ea0a8d6f02f191049
I20260808 17:43:23.058931 32453 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d: loading cluster ID for follower catalog manager: success
I20260808 17:43:23.059679 32453 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d: acquiring CA information for follower catalog manager: success
I20260808 17:43:23.059939 32453 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 319202ec27a54e49a45bdd791817d12d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:43:23.217403 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 32023
I20260808 17:43:23.232098 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 32159
I20260808 17:43:23.239967 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 32283
2026-08-08T17:43:23Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2986 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:43:23 dist-test-slave-bqcl krb5kdc[32507](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:43:23 dist-test-slave-bqcl krb5kdc[32507](info): set up 2 sockets
Aug 08 17:43:23 dist-test-slave-bqcl krb5kdc[32507](info): commencing operation
krb5kdc: starting...
W20260808 17:43:24.391918 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:43:24 dist-test-slave-bqcl krb5kdc[32507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:43:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:43:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:43:24.508486 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:35817
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:34241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:35817
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:24.588336 32527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:24.588538 32527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:24.588568 32527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:24.589670 32527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:43:24.589711 32527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:24.589730 32527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:24.589746 32527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:43:24.589762 32527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:43:24.591215 32527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:34241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:35817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:35817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:24.591450 32527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:24.591651 32527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:24.596112 32536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:24.596127 32537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:24.596146 32541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:24.596354 32527 server_base.cc:1034] running on GCE node
I20260808 17:43:24.596606 32527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:24.596882 32527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:24.598022 32527 hybrid_clock.cc:648] HybridClock initialized: now 1786211004598002 us; error 32 us; skew 500 ppm
Aug 08 17:43:24 dist-test-slave-bqcl krb5kdc[32507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211004, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:24.600719 32527 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:43:24.601169 32527 webserver.cc:460] Webserver started at http://127.9.187.254:37033/ using document root <none> and password file <none>
I20260808 17:43:24.601413 32527 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:24.601472 32527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:24.601604 32527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:24.602810 32527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "8b5e8fea33eb4bf195f3af893f3713b6"
format_stamp: "Formatted at 2026-08-08 17:43:24 on dist-test-slave-bqcl"
server_key: "4a365e76e02422630f27927b41452a6d"
server_key_iv: "d509d495104bba9ff38eaf4c1a734f7c"
server_key_version: "encryptionkey@0"
I20260808 17:43:24.603133 32527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "8b5e8fea33eb4bf195f3af893f3713b6"
format_stamp: "Formatted at 2026-08-08 17:43:24 on dist-test-slave-bqcl"
server_key: "4a365e76e02422630f27927b41452a6d"
server_key_iv: "d509d495104bba9ff38eaf4c1a734f7c"
server_key_version: "encryptionkey@0"
I20260808 17:43:24.604314 32527 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 17:43:24.604931 32555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:24.605064 32527 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:24.605147 32527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "8b5e8fea33eb4bf195f3af893f3713b6"
format_stamp: "Formatted at 2026-08-08 17:43:24 on dist-test-slave-bqcl"
server_key: "4a365e76e02422630f27927b41452a6d"
server_key_iv: "d509d495104bba9ff38eaf4c1a734f7c"
server_key_version: "encryptionkey@0"
I20260808 17:43:24.605218 32527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:24.633351 32527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:24.635002 32527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:24.635135 32527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:24.638851 32527 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:35817
I20260808 17:43:24.638885 32642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:35817 every 8 connection(s)
I20260808 17:43:24.639196 32527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:43:24.640028 32643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:24.642282 32643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6: Bootstrap starting.
I20260808 17:43:24.642890 32643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:24.643148 32643 log.cc:824] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:24.643172 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 32527
I20260808 17:43:24.643250 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:43:24.643455 9967 external_mini_cluster.cc:1428] Setting key 601c745cca0e0849250db8516b6f0047
I20260808 17:43:24.643896 32643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6: No bootstrap required, opened a new log
I20260808 17:43:24.645967 32643 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b5e8fea33eb4bf195f3af893f3713b6" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35817 } }
I20260808 17:43:24.646113 32643 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:24.646169 32643 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b5e8fea33eb4bf195f3af893f3713b6, State: Initialized, Role: FOLLOWER
I20260808 17:43:24.646293 32643 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b5e8fea33eb4bf195f3af893f3713b6" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35817 } }
I20260808 17:43:24.646363 32643 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:43:24.646385 32643 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:43:24.646430 32643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:24.646939 32643 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b5e8fea33eb4bf195f3af893f3713b6" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35817 } }
I20260808 17:43:24.647027 32643 leader_election.cc:302] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b5e8fea33eb4bf195f3af893f3713b6; no voters:
I20260808 17:43:24.647181 32643 leader_election.cc:288] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:43:24.647220 32649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:43:24.647369 32649 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [term 1 LEADER]: Becoming Leader. State: Replica: 8b5e8fea33eb4bf195f3af893f3713b6, State: Running, Role: LEADER
I20260808 17:43:24.647447 32643 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:43:24.647454 32649 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b5e8fea33eb4bf195f3af893f3713b6" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35817 } }
I20260808 17:43:24.647792 32649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b5e8fea33eb4bf195f3af893f3713b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b5e8fea33eb4bf195f3af893f3713b6" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35817 } } }
I20260808 17:43:24.647933 32649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:24.648128 32649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b5e8fea33eb4bf195f3af893f3713b6. Latest consensus state: current_term: 1 leader_uuid: "8b5e8fea33eb4bf195f3af893f3713b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b5e8fea33eb4bf195f3af893f3713b6" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 35817 } } }
I20260808 17:43:24.648195 32649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:24.648481 32664 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:43:24.649004 32664 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:43:24.650779 32664 catalog_manager.cc:1347] Generated new cluster ID: 741daf4038024faf9e8b8ef821fa3bd0
I20260808 17:43:24.650828 32664 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:43:24 dist-test-slave-bqcl krb5kdc[32507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:24.655709 32648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:24.643900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43990 (local address 127.9.187.254:35817)
0808 17:43:24.644074 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:24.644089 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:24.644118 (+ 29us) server_negotiation.cc:407] Connection header received
0808 17:43:24.645037 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:24.645045 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:24.645110 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:24.645218 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:24.645976 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:24.647279 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:24.648290 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:24.648842 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:24.648943 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:24.651770 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:24.651774 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:24.651775 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:24.651786 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:24.653666 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:24.654053 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:24.654056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:24.654056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:24.654187 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:24.654395 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:24.654396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:24.654396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:24.654707 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:24.654868 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:24.655353 (+ 485us) server_negotiation.cc:299] Negotiation successful
0808 17:43:24.655494 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":71,"threads_started":1}
I20260808 17:43:24.656383 32664 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:43:24.656765 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:43:24.656971 32664 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:43:24.663493 32664 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b5e8fea33eb4bf195f3af893f3713b6: Generated new TSK 0
I20260808 17:43:24.663666 32664 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:43:24.710462 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 32527
2026-08-08T17:43:24Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1473 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:43:24 dist-test-slave-bqcl krb5kdc[32687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:43:24 dist-test-slave-bqcl krb5kdc[32687](info): set up 2 sockets
Aug 08 17:43:24 dist-test-slave-bqcl krb5kdc[32687](info): commencing operation
krb5kdc: starting...
W20260808 17:43:25.858975 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:43:25 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:43:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:43:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:43:25.970407 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:38755
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:38755
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:26.050699 32707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:26.050912 32707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:26.050942 32707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:26.052053 32707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:43:26.052093 32707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:26.052111 32707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:26.052127 32707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:43:26.052141 32707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:43:26.053601 32707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:38755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:38755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:26.053856 32707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:26.054070 32707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:26.058709 32719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:26.058779 32722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:26.058724 32717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:26.058996 32707 server_base.cc:1034] running on GCE node
I20260808 17:43:26.059229 32707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:26.059491 32707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:26.060639 32707 hybrid_clock.cc:648] HybridClock initialized: now 1786211006060620 us; error 34 us; skew 500 ppm
Aug 08 17:43:26 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211006, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:26.063035 32707 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:43:26.063467 32707 webserver.cc:460] Webserver started at http://127.9.187.254:36419/ using document root <none> and password file <none>
I20260808 17:43:26.063673 32707 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:26.063730 32707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:26.063858 32707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:26.064886 32707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "2ce1b2807d3c4b479161be9b5b127813"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "1435e8f2cbcfa71fdfe46de4a6f8353f"
server_key_iv: "2b3c9dc081a5593a8485512613f7d552"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.065218 32707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "2ce1b2807d3c4b479161be9b5b127813"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "1435e8f2cbcfa71fdfe46de4a6f8353f"
server_key_iv: "2b3c9dc081a5593a8485512613f7d552"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.066490 32707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:43:26.067137 32738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.067283 32707 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:43:26.067369 32707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "2ce1b2807d3c4b479161be9b5b127813"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "1435e8f2cbcfa71fdfe46de4a6f8353f"
server_key_iv: "2b3c9dc081a5593a8485512613f7d552"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.067430 32707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:26.076434 32707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:26.078011 32707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:26.078186 32707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:26.081965 32707 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:38755
I20260808 17:43:26.081998 345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:38755 every 8 connection(s)
I20260808 17:43:26.082333 32707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:43:26.083272 346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:26.084568 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 32707
I20260808 17:43:26.084687 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:43:26.084870 9967 external_mini_cluster.cc:1428] Setting key 3e1fc2d8e1e58d35f5ce47ce8cd21f15
I20260808 17:43:26.085856 346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Bootstrap starting.
I20260808 17:43:26.086549 346 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:26.086889 346 log.cc:824] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:26.087553 346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: No bootstrap required, opened a new log
I20260808 17:43:26.089738 346 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:26.089905 346 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:26.089954 346 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce1b2807d3c4b479161be9b5b127813, State: Initialized, Role: FOLLOWER
I20260808 17:43:26.090086 346 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:26.090211 346 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:43:26.090255 346 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:43:26.090307 346 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:26.090977 346 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:26.091074 346 leader_election.cc:302] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ce1b2807d3c4b479161be9b5b127813; no voters:
I20260808 17:43:26.091225 346 leader_election.cc:288] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:43:26.091275 352 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 1 FOLLOWER]: Leader election won for term 1
Aug 08 17:43:26 dist-test-slave-bqcl krb5kdc[32687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:26.091485 346 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:43:26.091490 352 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 1 LEADER]: Becoming Leader. State: Replica: 2ce1b2807d3c4b479161be9b5b127813, State: Running, Role: LEADER
I20260808 17:43:26.091605 352 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:26.091995 353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ce1b2807d3c4b479161be9b5b127813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } } }
I20260808 17:43:26.092098 353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:26.091982 354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ce1b2807d3c4b479161be9b5b127813. Latest consensus state: current_term: 1 leader_uuid: "2ce1b2807d3c4b479161be9b5b127813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } } }
I20260808 17:43:26.092469 354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:26.092614 365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:43:26.093300 365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:43:26.094725 365 catalog_manager.cc:1347] Generated new cluster ID: 75ae85b8d5014584b167a12610330096
I20260808 17:43:26.094777 365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:43:26.096406 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.085369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54650 (local address 127.9.187.254:38755)
0808 17:43:26.085539 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.085547 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.085573 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:43:26.085992 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.086000 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.086048 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.086249 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:26.086967 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.087891 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.088930 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.089308 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.089378 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.092053 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:26.092058 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:26.092058 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:26.092070 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:26.094827 (+ 2757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.095200 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.095203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.095204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.095313 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.095492 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.095493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.095493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.095793 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:26.095948 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.096022 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.096172 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260808 17:43:26.104696 365 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:43:26.105163 365 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:43:26.110219 365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Generated new TSK 0
I20260808 17:43:26.110380 365 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:43:26.138523 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38755
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:26.217937 388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:26.218160 388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:26.218195 388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:26.219304 388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:26.219343 388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:26.219377 388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:43:26.220785 388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:26.221020 388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:26.221225 388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:26.225874 400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:26.225874 396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:26.226083 388 server_base.cc:1034] running on GCE node
W20260808 17:43:26.225956 397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:26.226346 388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:26.226550 388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:26.227684 388 hybrid_clock.cc:648] HybridClock initialized: now 1786211006227675 us; error 28 us; skew 500 ppm
Aug 08 17:43:26 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211006, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:26.230078 388 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:43:26.230481 388 webserver.cc:460] Webserver started at http://127.9.187.193:45987/ using document root <none> and password file <none>
I20260808 17:43:26.230696 388 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:26.230741 388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:26.230854 388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:26.231994 388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "20c20f11e54b4e3f8ee88cf5328e79c1"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "7b78cf0edd0aa39e6c6eefd00a94c32d"
server_key_iv: "ba7edb0b8c3506ab940a24615015c225"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.232345 388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "20c20f11e54b4e3f8ee88cf5328e79c1"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "7b78cf0edd0aa39e6c6eefd00a94c32d"
server_key_iv: "ba7edb0b8c3506ab940a24615015c225"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.233502 388 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 17:43:26.234113 415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.234295 388 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.234377 388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "20c20f11e54b4e3f8ee88cf5328e79c1"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "7b78cf0edd0aa39e6c6eefd00a94c32d"
server_key_iv: "ba7edb0b8c3506ab940a24615015c225"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.234429 388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:26.244592 388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:26.246193 388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:26.246302 388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:26.246462 388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:26.246702 388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:26.246732 388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.246758 388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:26.246774 388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.252094 388 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:32939
I20260808 17:43:26.252154 606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:32939 every 8 connection(s)
I20260808 17:43:26.252424 388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:43:26.252939 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 388
I20260808 17:43:26.253047 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:43:26.253247 9967 external_mini_cluster.cc:1428] Setting key 5152e524f72089b44644c5fa20bee907
Aug 08 17:43:26 dist-test-slave-bqcl krb5kdc[32687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211006, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:26.262567 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.253059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:37161 (local address 127.9.187.254:38755)
0808 17:43:26.253116 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.253119 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.253359 (+ 240us) server_negotiation.cc:407] Connection header received
0808 17:43:26.253924 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.253925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.253937 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.254011 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:26.254929 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.255629 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.256992 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.257260 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.257331 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.259650 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:26.259651 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:26.259652 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:26.259660 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:26.261175 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.261585 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.261586 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.261587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.261651 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.261873 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.261874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.261874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.261991 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:26.262050 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.262384 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.262476 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
I20260808 17:43:26.262722 611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.253037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:37161)
0808 17:43:26.253243 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:26.253285 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:26.253829 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:26.254069 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:26.254072 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:26.254654 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:26.254837 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.254843 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.255724 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.255725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.256911 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.256915 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.257332 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.257332 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.257432 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.257879 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:26.257887 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:26.259510 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:26.261250 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:26.261257 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:26.261259 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:26.261511 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:26.261711 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:26.261711 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:26.261712 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:26.261816 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:26.262046 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:26.262054 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:26.262257 (+ 203us) client_negotiation.cc:769] Sending connection context
0808 17:43:26.262350 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 17:43:26.262501 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":97,"threads_started":1}
I20260808 17:43:26.263164 607 heartbeater.cc:347] Connected to a master server at 127.9.187.254:38755
I20260808 17:43:26.263290 607 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:26.263473 607 heartbeater.cc:511] Master 127.9.187.254:38755 requested a full tablet report, sending...
I20260808 17:43:26.263975 32762 ts_manager.cc:194] Registered new tserver with Master: 20c20f11e54b4e3f8ee88cf5328e79c1 (127.9.187.193:32939)
I20260808 17:43:26.264595 32762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:37161
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:43:26.278484 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38755
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:26.357535 616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:26.357721 616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:26.357743 616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:26.358872 616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:26.358915 616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:26.358942 616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:43:26.360347 616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:26.360558 616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:26.360759 616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:43:26.365489 616 server_base.cc:1034] running on GCE node
W20260808 17:43:26.365453 629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:26.365456 631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:26.365469 627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:26.365851 616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:26.366096 616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:26.367259 616 hybrid_clock.cc:648] HybridClock initialized: now 1786211006367246 us; error 29 us; skew 500 ppm
Aug 08 17:43:26 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211006, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:26.369689 616 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:43:26.370114 616 webserver.cc:460] Webserver started at http://127.9.187.194:44523/ using document root <none> and password file <none>
I20260808 17:43:26.370364 616 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:26.370414 616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:26.370544 616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:26.371588 616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "54952da7342d457b99fc627093abbea7"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "080bbea09f6fa0674093e4862e1a8102"
server_key_iv: "60db36dc2d8a965fb93c15cc1ada1246"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.371937 616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "54952da7342d457b99fc627093abbea7"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "080bbea09f6fa0674093e4862e1a8102"
server_key_iv: "60db36dc2d8a965fb93c15cc1ada1246"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.373157 616 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:43:26.373828 639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.373977 616 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:43:26.374060 616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "54952da7342d457b99fc627093abbea7"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "080bbea09f6fa0674093e4862e1a8102"
server_key_iv: "60db36dc2d8a965fb93c15cc1ada1246"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.374151 616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:26.389869 616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:26.391963 616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:26.392087 616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:26.392282 616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:26.392584 616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:26.392661 616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.392699 616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:26.392710 616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.397930 616 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:42337
I20260808 17:43:26.397990 814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:42337 every 8 connection(s)
I20260808 17:43:26.398281 616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:43:26.402879 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 616
I20260808 17:43:26.402989 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:43:26.403163 9967 external_mini_cluster.cc:1428] Setting key 2221948ab5458a4d6ab9ceac0430ab28
Aug 08 17:43:26 dist-test-slave-bqcl krb5kdc[32687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211006, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:26.406991 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.398887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:41831 (local address 127.9.187.254:38755)
0808 17:43:26.398928 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.398930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.399140 (+ 210us) server_negotiation.cc:407] Connection header received
0808 17:43:26.399616 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.399617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.399631 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.399680 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:26.400571 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.401060 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.402012 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.402239 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.402292 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.404375 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:26.404376 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:26.404376 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:26.404385 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:26.405724 (+ 1339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.406080 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.406082 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.406082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.406164 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.406393 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.406394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.406394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.406507 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:26.406562 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.406824 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.406905 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:43:26.407137 820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.398864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:41831)
0808 17:43:26.399012 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:26.399055 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:26.399522 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:26.399769 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:26.399773 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:26.400303 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:26.400480 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.400485 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.401141 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.401142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.401931 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.401933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.402319 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.402321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.402442 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.402847 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:26.402854 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:26.404290 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:26.405799 (+ 1509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:26.405805 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:26.405808 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:26.406014 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:26.406221 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:26.406221 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:26.406221 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:26.406335 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:26.406563 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:26.406570 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:26.406705 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 17:43:26.406792 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 17:43:26.406938 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
I20260808 17:43:26.407650 816 heartbeater.cc:347] Connected to a master server at 127.9.187.254:38755
I20260808 17:43:26.407735 816 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:26.407888 816 heartbeater.cc:511] Master 127.9.187.254:38755 requested a full tablet report, sending...
I20260808 17:43:26.408243 32762 ts_manager.cc:194] Registered new tserver with Master: 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337)
I20260808 17:43:26.408720 32762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:41831
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:43:26.426645 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38755
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:26.506289 824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:26.506479 824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:26.506500 824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:26.507570 824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:26.507603 824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:26.507633 824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:43:26.509001 824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:26.509184 824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:26.509366 824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:26.514011 835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:26.514164 824 server_base.cc:1034] running on GCE node
W20260808 17:43:26.514029 836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:26.514252 841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:26.514470 824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:26.514706 824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:26.515841 824 hybrid_clock.cc:648] HybridClock initialized: now 1786211006515821 us; error 31 us; skew 500 ppm
Aug 08 17:43:26 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211006, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:26.518445 824 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:43:26.518877 824 webserver.cc:460] Webserver started at http://127.9.187.195:45197/ using document root <none> and password file <none>
I20260808 17:43:26.519070 824 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:26.519119 824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:26.519209 824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:26.520135 824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "dcd4128e560040ce86e195322db02de3"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "25033c695d6e659a81364195c7567043"
server_key_iv: "d48af2891772a01c26c49668b4734382"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.520424 824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "dcd4128e560040ce86e195322db02de3"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "25033c695d6e659a81364195c7567043"
server_key_iv: "d48af2891772a01c26c49668b4734382"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.521564 824 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:43:26.522186 850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.522336 824 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.522420 824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "dcd4128e560040ce86e195322db02de3"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "25033c695d6e659a81364195c7567043"
server_key_iv: "d48af2891772a01c26c49668b4734382"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.522490 824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:26.537433 824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:26.539201 824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:26.539321 824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:26.539506 824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:26.539777 824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:26.539810 824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.539830 824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:26.539852 824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.545233 824 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:36503
I20260808 17:43:26.545305 1018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:36503 every 8 connection(s)
I20260808 17:43:26.545576 824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:43:26.551113 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 824
Aug 08 17:43:26 dist-test-slave-bqcl krb5kdc[32687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211006, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:26.551225 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:43:26.551404 9967 external_mini_cluster.cc:1428] Setting key 0f29164377444fb0ab1c6bbfed7c5a69
I20260808 17:43:26.554189 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.546216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:47457 (local address 127.9.187.254:38755)
0808 17:43:26.546268 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.546270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.546465 (+ 195us) server_negotiation.cc:407] Connection header received
0808 17:43:26.546937 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.546938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.546951 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.547003 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:26.547898 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.548405 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.549362 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.549565 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.549626 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.551732 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:26.551733 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:26.551734 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:26.551740 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:26.552936 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.553292 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.553293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.553293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.553349 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.553561 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.553562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.553563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.553673 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:26.553729 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.553980 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.554056 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:43:26.554333 1022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.546219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:47457)
0808 17:43:26.546350 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:26.546385 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:26.546835 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:26.547068 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:26.547072 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:26.547615 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:26.547795 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.547800 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.548488 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.548489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.549272 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.549273 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.549639 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.549640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.549753 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.550171 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:26.550178 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:26.551641 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:26.553008 (+ 1367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:26.553015 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:26.553017 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:26.553225 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:26.553400 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:26.553401 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:26.553401 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:26.553506 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:26.553728 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:26.553735 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:26.553863 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 17:43:26.553952 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 17:43:26.554101 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":67,"threads_started":1}
I20260808 17:43:26.554730 1019 heartbeater.cc:347] Connected to a master server at 127.9.187.254:38755
I20260808 17:43:26.554818 1019 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:26.554994 1019 heartbeater.cc:511] Master 127.9.187.254:38755 requested a full tablet report, sending...
I20260808 17:43:26.555316 32762 ts_manager.cc:194] Registered new tserver with Master: dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503)
I20260808 17:43:26.555672 32762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:47457
I20260808 17:43:26.562965 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:43:26.569283 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.564172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54656 (local address 127.9.187.254:38755)
0808 17:43:26.564234 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.564236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.564329 (+ 93us) server_negotiation.cc:407] Connection header received
0808 17:43:26.564369 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.564370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.564378 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.564421 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:26.564904 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.565374 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.566048 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.566264 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.566309 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.567300 (+ 991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:26.567301 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:26.567301 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:26.567307 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:26.568467 (+ 1160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.568725 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.568725 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.568725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.568770 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.568878 (+ 108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.568878 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.568879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.569000 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:26.569068 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.569142 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.569210 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 17:43:26.570611 32762 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54656:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:43:26.572137 32762 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:43:26.577617 1029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.574072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:36503 (local address 127.0.0.1:52120)
0808 17:43:26.574205 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:26.574253 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:26.574324 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:26.574593 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:26.574597 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:26.574599 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:26.574662 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.574665 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.575666 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.575666 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.576528 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.576530 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.577331 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.577333 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.577416 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.577430 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:43:26.577490 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 17:43:26.577545 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":83,"threads_started":1}
I20260808 17:43:26.577626 1030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.574174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52120 (local address 127.9.187.195:36503)
0808 17:43:26.574355 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.574360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.574369 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:43:26.574407 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.574409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.574423 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.574506 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:26.574733 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.575583 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.576600 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.577253 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.577316 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.577373 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.577510 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.577545 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":84,"threads_started":1}
I20260808 17:43:26.578594 916 tablet_service.cc:1467] Processing CreateTablet for tablet a045137ff1ee406dbdea2e5588e44120 (DEFAULT_TABLE table=test-table [id=621a91b277ba4dafa54fe37115c39628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:26.578800 1034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.574421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:42337 (local address 127.0.0.1:55880)
0808 17:43:26.574660 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:26.574670 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:26.574712 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:26.575128 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:26.575129 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:26.575131 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:26.575174 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.575176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.576420 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.576421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.577640 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.577643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.578558 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.578559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.578625 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.578630 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:43:26.578699 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 17:43:26.578737 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":42,"thread_start_us":69,"threads_started":1}
I20260808 17:43:26.578899 1031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.574286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:32939 (local address 127.0.0.1:52774)
0808 17:43:26.574372 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:26.574381 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:26.574425 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:26.575048 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:26.575048 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:26.575050 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:26.575095 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.575096 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.576405 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.576406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.577692 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.577695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.578666 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.578667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.578732 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.578736 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:43:26.578781 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:43:26.578821 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"mutex_wait_us":63,"thread_start_us":52,"threads_started":1}
I20260808 17:43:26.578976 916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a045137ff1ee406dbdea2e5588e44120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:26.579178 1038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.574520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55880 (local address 127.9.187.194:42337)
0808 17:43:26.574903 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.574907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.574918 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:43:26.574955 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.574957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.574972 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.575051 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:26.575241 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.576321 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.577733 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.578474 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.578548 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.578603 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.578903 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.579101 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":82,"threads_started":1}
I20260808 17:43:26.579358 1039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.574659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52774 (local address 127.9.187.193:32939)
0808 17:43:26.574832 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.574837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.574846 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:43:26.574883 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.574885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.574899 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.574967 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:26.575170 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.576294 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.577766 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.578584 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.578651 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.578706 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.579221 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.579270 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":111,"threads_started":1}
I20260808 17:43:26.579929 496 tablet_service.cc:1467] Processing CreateTablet for tablet a045137ff1ee406dbdea2e5588e44120 (DEFAULT_TABLE table=test-table [id=621a91b277ba4dafa54fe37115c39628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:26.580178 496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a045137ff1ee406dbdea2e5588e44120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:26.581617 1040 tablet_bootstrap.cc:492] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3: Bootstrap starting.
I20260808 17:43:26.582063 716 tablet_service.cc:1467] Processing CreateTablet for tablet a045137ff1ee406dbdea2e5588e44120 (DEFAULT_TABLE table=test-table [id=621a91b277ba4dafa54fe37115c39628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:26.582299 1040 tablet_bootstrap.cc:654] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:26.582391 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a045137ff1ee406dbdea2e5588e44120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:26.582901 1041 tablet_bootstrap.cc:492] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Bootstrap starting.
I20260808 17:43:26.582952 1040 log.cc:824] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:26.583531 1041 tablet_bootstrap.cc:654] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:26.583722 1040 tablet_bootstrap.cc:492] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3: No bootstrap required, opened a new log
I20260808 17:43:26.583786 1040 ts_tablet_manager.cc:1397] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:43:26.584132 1041 log.cc:824] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:26.584923 1041 tablet_bootstrap.cc:492] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: No bootstrap required, opened a new log
I20260808 17:43:26.584985 1041 ts_tablet_manager.cc:1397] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:43:26.585209 1040 raft_consensus.cc:348] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } }
I20260808 17:43:26.585364 1040 raft_consensus.cc:374] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:26.585400 1040 raft_consensus.cc:729] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcd4128e560040ce86e195322db02de3, State: Initialized, Role: FOLLOWER
I20260808 17:43:26.585460 1046 tablet_bootstrap.cc:492] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: Bootstrap starting.
I20260808 17:43:26.585520 1040 consensus_queue.cc:260] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } }
I20260808 17:43:26.585813 1040 ts_tablet_manager.cc:1428] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:43:26.585834 1019 heartbeater.cc:503] Master 127.9.187.254:38755 was elected leader, sending a full tablet report...
I20260808 17:43:26.586181 1046 tablet_bootstrap.cc:654] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:26.586766 1046 log.cc:824] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:26.586930 1041 raft_consensus.cc:348] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } }
I20260808 17:43:26.587110 1041 raft_consensus.cc:374] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:26.587159 1041 raft_consensus.cc:729] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c20f11e54b4e3f8ee88cf5328e79c1, State: Initialized, Role: FOLLOWER
I20260808 17:43:26.587272 1041 consensus_queue.cc:260] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } }
I20260808 17:43:26.587491 1046 tablet_bootstrap.cc:492] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: No bootstrap required, opened a new log
I20260808 17:43:26.587538 1041 ts_tablet_manager.cc:1428] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:43:26.587565 607 heartbeater.cc:503] Master 127.9.187.254:38755 was elected leader, sending a full tablet report...
I20260808 17:43:26.587597 1046 ts_tablet_manager.cc:1397] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:43:26.589125 1046 raft_consensus.cc:348] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } }
I20260808 17:43:26.589259 1046 raft_consensus.cc:374] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:26.589282 1046 raft_consensus.cc:729] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54952da7342d457b99fc627093abbea7, State: Initialized, Role: FOLLOWER
I20260808 17:43:26.589356 1046 consensus_queue.cc:260] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } }
I20260808 17:43:26.589550 1046 ts_tablet_manager.cc:1428] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:43:26.589593 816 heartbeater.cc:503] Master 127.9.187.254:38755 was elected leader, sending a full tablet report...
I20260808 17:43:26.636569 1052 raft_consensus.cc:482] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:43:26.636688 1052 raft_consensus.cc:504] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } }
I20260808 17:43:26.637056 1052 leader_election.cc:288] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503), 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337)
I20260808 17:43:26.639909 1030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.637327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:40271 (local address 127.9.187.195:36503)
0808 17:43:26.637378 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.637380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.637390 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:43:26.637425 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.637427 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.637437 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.637490 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:26.637674 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.638202 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.639149 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.639602 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.639662 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.639670 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.639826 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.639852 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:43:26.639932 611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.637241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:36503 (local address 127.9.187.193:40271)
0808 17:43:26.637298 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:26.637311 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:26.637362 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:26.637506 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:26.637508 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:26.637509 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:26.637595 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.637597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.638267 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.638268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.639062 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.639064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.639674 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.639675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.639757 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.639761 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:43:26.639819 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 17:43:26.639857 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 17:43:26.640182 1038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.637434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:46087 (local address 127.9.187.194:42337)
0808 17:43:26.637495 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.637497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.637590 (+ 93us) server_negotiation.cc:407] Connection header received
0808 17:43:26.637635 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.637636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.637648 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.637715 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:26.637856 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.638433 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.639422 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.639863 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.639926 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.639933 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.640077 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.640120 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 17:43:26.640193 1056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.637347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:42337 (local address 127.9.187.193:46087)
0808 17:43:26.637526 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:26.637535 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:26.637586 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:26.637721 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:26.637721 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:26.637723 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:26.637795 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.637797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.638507 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.638508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.639340 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.639343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.639936 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.639937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.640008 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.640013 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:43:26.640068 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 17:43:26.640105 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":104,"threads_started":1}
I20260808 17:43:26.640290 946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a045137ff1ee406dbdea2e5588e44120" candidate_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcd4128e560040ce86e195322db02de3" is_pre_election: true
I20260808 17:43:26.640452 946 raft_consensus.cc:2454] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c20f11e54b4e3f8ee88cf5328e79c1 in term 0.
I20260808 17:43:26.640678 418 leader_election.cc:302] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c20f11e54b4e3f8ee88cf5328e79c1, dcd4128e560040ce86e195322db02de3; no voters:
I20260808 17:43:26.640806 1052 raft_consensus.cc:2781] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:43:26.640789 746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a045137ff1ee406dbdea2e5588e44120" candidate_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54952da7342d457b99fc627093abbea7" is_pre_election: true
I20260808 17:43:26.640877 1052 raft_consensus.cc:482] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:43:26.640908 1052 raft_consensus.cc:3037] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:26.640935 746 raft_consensus.cc:2454] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c20f11e54b4e3f8ee88cf5328e79c1 in term 0.
I20260808 17:43:26.641674 1052 raft_consensus.cc:504] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } }
I20260808 17:43:26.641779 1052 leader_election.cc:288] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 1 election: Requested vote from peers dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503), 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337)
I20260808 17:43:26.641940 946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a045137ff1ee406dbdea2e5588e44120" candidate_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcd4128e560040ce86e195322db02de3"
I20260808 17:43:26.641991 746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a045137ff1ee406dbdea2e5588e44120" candidate_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54952da7342d457b99fc627093abbea7"
I20260808 17:43:26.642025 946 raft_consensus.cc:3037] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:26.642066 746 raft_consensus.cc:3037] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:26.642925 746 raft_consensus.cc:2454] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c20f11e54b4e3f8ee88cf5328e79c1 in term 1.
I20260808 17:43:26.642925 946 raft_consensus.cc:2454] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c20f11e54b4e3f8ee88cf5328e79c1 in term 1.
I20260808 17:43:26.643100 418 leader_election.cc:302] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c20f11e54b4e3f8ee88cf5328e79c1, 54952da7342d457b99fc627093abbea7; no voters:
I20260808 17:43:26.643195 1052 raft_consensus.cc:2781] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:43:26.643327 1052 raft_consensus.cc:686] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 LEADER]: Becoming Leader. State: Replica: 20c20f11e54b4e3f8ee88cf5328e79c1, State: Running, Role: LEADER
I20260808 17:43:26.643406 1052 consensus_queue.cc:237] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } }
I20260808 17:43:26.644199 32762 catalog_manager.cc:5495] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c20f11e54b4e3f8ee88cf5328e79c1 (127.9.187.193). New cstate: current_term: 1 leader_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } health_report { overall_health: UNKNOWN } } }
W20260808 17:43:26.648775 817 tablet.cc:2369] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:43:26.650405 1039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.648332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52790 (local address 127.9.187.193:32939)
0808 17:43:26.648369 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.648371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.648378 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:43:26.648430 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.648431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.648446 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.648501 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:43:26.648584 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.649133 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.649819 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.649989 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.650029 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.650142 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:43:26.650236 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:43:26.650294 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.650314 (+ 20us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.650330 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:43:26.651916 746 raft_consensus.cc:1261] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7 [term 1 FOLLOWER]: Refusing update from remote peer 20c20f11e54b4e3f8ee88cf5328e79c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:43:26.651927 946 raft_consensus.cc:1261] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3 [term 1 FOLLOWER]: Refusing update from remote peer 20c20f11e54b4e3f8ee88cf5328e79c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:43:26.652200 1052 consensus_queue.cc:1035] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:43:26.652336 1057 consensus_queue.cc:1035] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:43:26.654805 1063 mvcc.cc:205] Tried to move back new op lower bound from 7316320283244064768 to 7316320283211943936. Current Snapshot: MvccSnapshot[applied={T|T < 7316320283244064768}]
I20260808 17:43:26.654928 1064 mvcc.cc:205] Tried to move back new op lower bound from 7316320283244064768 to 7316320283211943936. Current Snapshot: MvccSnapshot[applied={T|T < 7316320283244064768}]
I20260808 17:43:26.656517 32762 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:43:26.656612 32762 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:43:26.657317 32762 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Sending DeleteTablet for 3 replicas of tablet a045137ff1ee406dbdea2e5588e44120
I20260808 17:43:26.657640 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 388
I20260808 17:43:26.657673 916 tablet_service.cc:1514] Processing DeleteTablet for tablet a045137ff1ee406dbdea2e5588e44120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:26 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:52120
I20260808 17:43:26.657764 496 tablet_service.cc:1514] Processing DeleteTablet for tablet a045137ff1ee406dbdea2e5588e44120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:26 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:52774
I20260808 17:43:26.660266 716 tablet_service.cc:1514] Processing DeleteTablet for tablet a045137ff1ee406dbdea2e5588e44120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:26 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:55880
I20260808 17:43:26.664887 1078 tablet_replica.cc:330] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: stopping tablet replica
I20260808 17:43:26.664991 1078 raft_consensus.cc:2229] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:43:26.665081 1078 raft_consensus.cc:2258] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:43:26.666632 1077 tablet_replica.cc:330] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3: stopping tablet replica
I20260808 17:43:26.666736 1077 raft_consensus.cc:2229] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:43:26.666824 1077 raft_consensus.cc:2258] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:43:26.666919 1078 ts_tablet_manager.cc:1905] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:43:26.668130 1077 ts_tablet_manager.cc:1905] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:43:26.668757 1078 ts_tablet_manager.cc:1918] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:43:26.668895 1078 log.cc:1196] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/a045137ff1ee406dbdea2e5588e44120
I20260808 17:43:26.669323 1078 ts_tablet_manager.cc:1939] T a045137ff1ee406dbdea2e5588e44120 P 54952da7342d457b99fc627093abbea7: Deleting consensus metadata
I20260808 17:43:26.669384 1077 ts_tablet_manager.cc:1918] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:43:26.669538 1077 log.cc:1196] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/a045137ff1ee406dbdea2e5588e44120
I20260808 17:43:26.669836 1077 ts_tablet_manager.cc:1939] T a045137ff1ee406dbdea2e5588e44120 P dcd4128e560040ce86e195322db02de3: Deleting consensus metadata
I20260808 17:43:26.669890 32740 catalog_manager.cc:4841] TS 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337): tablet a045137ff1ee406dbdea2e5588e44120 (table test-table [id=621a91b277ba4dafa54fe37115c39628]) successfully deleted
I20260808 17:43:26.670259 32740 catalog_manager.cc:4841] TS dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503): tablet a045137ff1ee406dbdea2e5588e44120 (table test-table [id=621a91b277ba4dafa54fe37115c39628]) successfully deleted
W20260808 17:43:26.674845 32740 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:32939 (error 108)
I20260808 17:43:26.675145 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 616
I20260808 17:43:26.675299 1031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.675169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:32939 (local address 127.0.0.1:52792)
0808 17:43:26.675223 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:26.675266 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:32939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 17:43:26.686749 32740 catalog_manager.cc:4584] TS 20c20f11e54b4e3f8ee88cf5328e79c1 (127.9.187.193:32939): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a045137ff1ee406dbdea2e5588e44120: Network error: Client connection negotiation failed: client connection to 127.9.187.193:32939: connect: Connection refused (error 111)
I20260808 17:43:26.689976 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 824
I20260808 17:43:26.700111 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 32707
I20260808 17:43:26.710685 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:38755
--webserver_interface=127.9.187.254
--webserver_port=36419
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:38755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:26.790949 1085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:26.791154 1085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:26.791186 1085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:26.792286 1085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:43:26.792325 1085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:26.792344 1085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:26.792359 1085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:43:26.792375 1085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:43:26.793802 1085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:38755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:38755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=36419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:26.794041 1085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:26.794267 1085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:26.804687 1096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:26.804698 1092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:26.804780 1091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:26.805014 1085 server_base.cc:1034] running on GCE node
I20260808 17:43:26.805292 1085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:26.805598 1085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:26.806734 1085 hybrid_clock.cc:648] HybridClock initialized: now 1786211006806720 us; error 30 us; skew 500 ppm
Aug 08 17:43:26 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211006, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:26.812517 1085 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:43:26.812960 1085 webserver.cc:460] Webserver started at http://127.9.187.254:36419/ using document root <none> and password file <none>
I20260808 17:43:26.813189 1085 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:26.813253 1085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:26.814570 1085 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:26.815169 1106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.815320 1085 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:43:26.815405 1085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "2ce1b2807d3c4b479161be9b5b127813"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "1435e8f2cbcfa71fdfe46de4a6f8353f"
server_key_iv: "2b3c9dc081a5593a8485512613f7d552"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.815771 1085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:26.824397 1085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:26.825990 1085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:26.826153 1085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:26.829927 1085 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:38755
I20260808 17:43:26.829957 1198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:38755 every 8 connection(s)
I20260808 17:43:26.830325 1085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:43:26.831871 1200 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:43:26.832484 1200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Bootstrap starting.
I20260808 17:43:26.835479 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 1085
I20260808 17:43:26.835726 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:32939
--local_ip_for_outbound_sockets=127.9.187.193
--tserver_master_addrs=127.9.187.254:38755
--webserver_port=45987
--webserver_interface=127.9.187.193
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:43:26.841193 1200 log.cc:824] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:26.843128 1200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:43:26.843407 1200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Bootstrap complete.
I20260808 17:43:26.845522 1200 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:26.845739 1200 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce1b2807d3c4b479161be9b5b127813, State: Initialized, Role: FOLLOWER
I20260808 17:43:26.845881 1200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:26.845940 1200 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:43:26.845974 1200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:43:26.846020 1200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:43:26.847015 1200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:26.847105 1200 leader_election.cc:302] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ce1b2807d3c4b479161be9b5b127813; no voters:
I20260808 17:43:26.847263 1200 leader_election.cc:288] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 17:43:26.847312 1209 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 17:43:26.847427 1209 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 2 LEADER]: Becoming Leader. State: Replica: 2ce1b2807d3c4b479161be9b5b127813, State: Running, Role: LEADER
I20260808 17:43:26.847532 1200 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:43:26.847575 1209 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:26.847908 1214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2ce1b2807d3c4b479161be9b5b127813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } } }
I20260808 17:43:26.848105 1214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:26.848052 1209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ce1b2807d3c4b479161be9b5b127813. Latest consensus state: current_term: 2 leader_uuid: "2ce1b2807d3c4b479161be9b5b127813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } } }
I20260808 17:43:26.848335 1209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:26.848382 1227 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:43:26.849180 1227 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:43:26.849352 1227 catalog_manager.cc:1259] Loaded cluster ID: 75ae85b8d5014584b167a12610330096
I20260808 17:43:26.849534 1227 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:43:26.849751 1227 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 17:43:26.852437 1227 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 17:43:26.854153 1227 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:43:26.854367 1227 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Loaded TSK: 0
I20260808 17:43:26.854688 1227 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:43:26.935920 1207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:26.936121 1207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:26.936151 1207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:26.937288 1207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:26.937332 1207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:26.937367 1207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:43:26.938853 1207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:32939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=45987
--tserver_master_addrs=127.9.187.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:26.939078 1207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:26.939283 1207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:26.945039 1257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:26.945062 1258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:26.945236 1207 server_base.cc:1034] running on GCE node
W20260808 17:43:26.945062 1260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:26.945529 1207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:26.945760 1207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:26.946930 1207 hybrid_clock.cc:648] HybridClock initialized: now 1786211006946911 us; error 32 us; skew 500 ppm
Aug 08 17:43:26 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211006, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:26.950011 1207 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:43:26.950585 1207 webserver.cc:460] Webserver started at http://127.9.187.193:45987/ using document root <none> and password file <none>
I20260808 17:43:26.950860 1207 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:26.950948 1207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:26.952695 1207 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:43:26.953450 1275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:26.953620 1207 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:43:26.953706 1207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "20c20f11e54b4e3f8ee88cf5328e79c1"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "7b78cf0edd0aa39e6c6eefd00a94c32d"
server_key_iv: "ba7edb0b8c3506ab940a24615015c225"
server_key_version: "encryptionkey@0"
I20260808 17:43:26.954030 1207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:26.964907 1207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:26.967049 1207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:26.967164 1207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:26.967374 1207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:26.967803 1285 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 17:43:26.969746 1207 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 17:43:26.969789 1207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 17:43:26.969820 1207 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 17:43:26.970470 1207 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 17:43:26.970504 1207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 17:43:26.970592 1285 tablet_bootstrap.cc:492] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Bootstrap starting.
I20260808 17:43:26.977182 1207 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:32939
I20260808 17:43:26.977329 1459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:32939 every 8 connection(s)
I20260808 17:43:26.977627 1207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:43:26.981339 1285 log.cc:824] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:26.981483 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 1207
I20260808 17:43:26.981748 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:42337
--local_ip_for_outbound_sockets=127.9.187.194
--tserver_master_addrs=127.9.187.254:38755
--webserver_port=44523
--webserver_interface=127.9.187.194
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:43:26.984012 1285 tablet_bootstrap.cc:492] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:43:26.984375 1285 tablet_bootstrap.cc:492] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Bootstrap complete.
I20260808 17:43:26.985526 1285 ts_tablet_manager.cc:1397] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.014s
I20260808 17:43:26.986937 1285 raft_consensus.cc:348] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } }
I20260808 17:43:26.987356 1285 raft_consensus.cc:729] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c20f11e54b4e3f8ee88cf5328e79c1, State: Initialized, Role: FOLLOWER
I20260808 17:43:26.987562 1285 consensus_queue.cc:260] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } }
I20260808 17:43:26.987888 1285 ts_tablet_manager.cc:1428] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
Aug 08 17:43:26 dist-test-slave-bqcl krb5kdc[32687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211006, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:26.995801 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.978370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:53671)
0808 17:43:26.983532 (+ 5162us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:26.983586 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:26.984202 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:26.984847 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:26.984851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:26.985141 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:26.985351 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.985356 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.986939 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.986940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.988213 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:26.988217 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.989017 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.989018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:26.989164 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.989807 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:26.989818 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:26.991696 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:26.993971 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:26.993980 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:26.993982 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:26.994346 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:26.994627 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:26.994627 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:26.994628 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:26.994764 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:26.995175 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:26.995185 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:26.995335 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 17:43:26.995435 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 17:43:26.995596 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5110,"thread_start_us":95,"threads_started":1}
I20260808 17:43:26.995821 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.978456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:53671 (local address 127.9.187.254:38755)
0808 17:43:26.984425 (+ 5969us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:26.984434 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:26.984475 (+ 41us) server_negotiation.cc:407] Connection header received
0808 17:43:26.984615 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:26.984621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:26.984678 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:26.984818 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:26.985478 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.986825 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.988319 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:26.988908 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:26.989028 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:26.991824 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:26.991830 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:26.991831 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:26.991844 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:26.993878 (+ 2034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.994435 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.994439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.994439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.994556 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:26.994830 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:26.994830 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:26.994831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:26.995114 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:26.995188 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:26.995498 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 17:43:26.995632 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5910,"thread_start_us":72,"threads_started":1}
I20260808 17:43:26.996958 1460 heartbeater.cc:347] Connected to a master server at 127.9.187.254:38755
I20260808 17:43:26.997064 1460 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:26.997260 1460 heartbeater.cc:511] Master 127.9.187.254:38755 requested a full tablet report, sending...
I20260808 17:43:26.997956 1136 ts_manager.cc:194] Registered new tserver with Master: 20c20f11e54b4e3f8ee88cf5328e79c1 (127.9.187.193:32939)
I20260808 17:43:26.999213 1136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:53671
I20260808 17:43:27.000149 1460 heartbeater.cc:503] Master 127.9.187.254:38755 was elected leader, sending a full tablet report...
I20260808 17:43:27.005686 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.998877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52798 (local address 127.9.187.193:32939)
0808 17:43:27.002457 (+ 3580us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:27.002461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:27.002470 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:43:27.002497 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:27.002498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:27.002510 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:27.002580 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:27.002709 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.003333 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.004772 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.005303 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.005366 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.005403 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:27.005603 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 17:43:27.005634 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3552,"thread_start_us":76,"threads_started":1}
I20260808 17:43:27.005715 1475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:26.998630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:32939 (local address 127.0.0.1:52798)
0808 17:43:27.002241 (+ 3611us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.002283 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:27.002351 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:27.002595 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:27.002597 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:27.002599 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:27.002658 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.002660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.003395 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.003396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.004660 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.004663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.005387 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.005389 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.005488 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.005502 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:43:27.005578 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 17:43:27.005639 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3577,"thread_start_us":91,"threads_started":1}
I20260808 17:43:27.006108 1354 tablet_service.cc:1514] Processing DeleteTablet for tablet a045137ff1ee406dbdea2e5588e44120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:26 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:52798
I20260808 17:43:27.006630 1479 tablet_replica.cc:330] stopping tablet replica
I20260808 17:43:27.006723 1479 raft_consensus.cc:2229] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:43:27.006789 1479 raft_consensus.cc:2258] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:43:27.007076 1479 ts_tablet_manager.cc:1905] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:43:27.009037 1479 ts_tablet_manager.cc:1918] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:43:27.009097 1479 log.cc:1196] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal/wals/a045137ff1ee406dbdea2e5588e44120
I20260808 17:43:27.009296 1479 ts_tablet_manager.cc:1939] T a045137ff1ee406dbdea2e5588e44120 P 20c20f11e54b4e3f8ee88cf5328e79c1: Deleting consensus metadata
I20260808 17:43:27.009783 1108 catalog_manager.cc:4841] TS 20c20f11e54b4e3f8ee88cf5328e79c1 (127.9.187.193:32939): tablet a045137ff1ee406dbdea2e5588e44120 (table test-table [id=621a91b277ba4dafa54fe37115c39628]) successfully deleted
W20260808 17:43:27.069768 1472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:27.069973 1472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:27.070004 1472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:27.071163 1472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:27.071209 1472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:27.071245 1472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:43:27.072664 1472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:42337
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=44523
--tserver_master_addrs=127.9.187.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:27.072914 1472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:27.073124 1472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:27.078090 1487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:27.078100 1491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:27.078274 1472 server_base.cc:1034] running on GCE node
W20260808 17:43:27.078146 1486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:27.078543 1472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:27.078809 1472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:27.079962 1472 hybrid_clock.cc:648] HybridClock initialized: now 1786211007079943 us; error 32 us; skew 500 ppm
Aug 08 17:43:27 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211007, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:27.082440 1472 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:43:27.082937 1472 webserver.cc:460] Webserver started at http://127.9.187.194:44523/ using document root <none> and password file <none>
I20260808 17:43:27.083171 1472 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:27.083236 1472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:27.084651 1472 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:43:27.085275 1500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.085444 1472 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:43:27.085567 1472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "54952da7342d457b99fc627093abbea7"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "080bbea09f6fa0674093e4862e1a8102"
server_key_iv: "60db36dc2d8a965fb93c15cc1ada1246"
server_key_version: "encryptionkey@0"
I20260808 17:43:27.085916 1472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:27.108359 1472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:27.110561 1472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:27.110702 1472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:27.110910 1472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:27.111213 1472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:27.111246 1472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.111276 1472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:27.111299 1472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.116681 1472 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:42337
I20260808 17:43:27.116744 1695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:42337 every 8 connection(s)
I20260808 17:43:27.117056 1472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:43:27.119243 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 1472
I20260808 17:43:27.119503 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:36503
--local_ip_for_outbound_sockets=127.9.187.195
--tserver_master_addrs=127.9.187.254:38755
--webserver_port=45197
--webserver_interface=127.9.187.195
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 17:43:27 dist-test-slave-bqcl krb5kdc[32687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211007, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:27.126991 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.117763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:57575 (local address 127.9.187.254:38755)
0808 17:43:27.117809 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:27.117811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:27.118041 (+ 230us) server_negotiation.cc:407] Connection header received
0808 17:43:27.118585 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:27.118587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:27.118604 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:27.118657 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:27.119756 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.120264 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.121451 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.121691 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.121751 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.124149 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:27.124152 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:27.124152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:27.124179 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:27.125643 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:27.126031 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:27.126032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:27.126033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:27.126095 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:27.126352 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:27.126353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:27.126354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:27.126496 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:27.126570 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:27.126796 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 17:43:27.126893 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:43:27.127032 1700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.117762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:57575)
0808 17:43:27.117922 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.117958 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:27.118487 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:27.118729 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:27.118733 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:27.119388 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:27.119602 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.119621 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.120354 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.120356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.121362 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.121366 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.121773 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.121774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.121914 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.122394 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:27.122404 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:27.124014 (+ 1610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:27.125732 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:27.125738 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:27.125740 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:27.125957 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:27.126189 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:27.126190 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:27.126190 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:27.126292 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:27.126558 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:27.126561 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:27.126670 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 17:43:27.126755 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 17:43:27.126875 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260808 17:43:27.127650 1696 heartbeater.cc:347] Connected to a master server at 127.9.187.254:38755
I20260808 17:43:27.127758 1696 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:27.127956 1696 heartbeater.cc:511] Master 127.9.187.254:38755 requested a full tablet report, sending...
I20260808 17:43:27.128365 1136 ts_manager.cc:194] Registered new tserver with Master: 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337)
I20260808 17:43:27.128865 1136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:57575
W20260808 17:43:27.203080 1701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:27.203280 1701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:27.203301 1701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:27.204361 1701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:27.204394 1701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:27.204417 1701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:43:27.205886 1701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:36503
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=45197
--tserver_master_addrs=127.9.187.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:27.206085 1701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:27.206293 1701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:27.210952 1709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:27.210942 1712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:27.210942 1708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:27.211036 1701 server_base.cc:1034] running on GCE node
I20260808 17:43:27.211421 1701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:27.211666 1701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:27.212795 1701 hybrid_clock.cc:648] HybridClock initialized: now 1786211007212787 us; error 27 us; skew 500 ppm
Aug 08 17:43:27 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211007, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:27.215154 1701 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:43:27.215596 1701 webserver.cc:460] Webserver started at http://127.9.187.195:45197/ using document root <none> and password file <none>
I20260808 17:43:27.215826 1701 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:27.215885 1701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:27.217098 1701 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:27.217592 1726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.217761 1701 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.217844 1701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "dcd4128e560040ce86e195322db02de3"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "25033c695d6e659a81364195c7567043"
server_key_iv: "d48af2891772a01c26c49668b4734382"
server_key_version: "encryptionkey@0"
I20260808 17:43:27.218194 1701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:27.229218 1701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:27.230862 1701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:27.230991 1701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:27.231186 1701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:27.231463 1701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:27.231495 1701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.231523 1701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:27.231547 1701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.237025 1701 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:36503
I20260808 17:43:27.237078 1906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:36503 every 8 connection(s)
I20260808 17:43:27.237387 1701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:43:27 dist-test-slave-bqcl krb5kdc[32687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211007, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:27.245715 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 1701
I20260808 17:43:27.245841 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.238033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:53935 (local address 127.9.187.254:38755)
0808 17:43:27.238094 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:27.238096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:27.238308 (+ 212us) server_negotiation.cc:407] Connection header received
0808 17:43:27.238773 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:27.238774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:27.238785 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:27.238837 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:27.239748 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.240229 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.241141 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.241318 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.241361 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.243423 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:27.243424 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:27.243424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:27.243432 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:27.244542 (+ 1110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:27.244906 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:27.244908 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:27.244908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:27.244961 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:27.245182 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:27.245183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:27.245184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:27.245303 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:27.245360 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:27.245666 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 17:43:27.245749 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 17:43:27.246008 1914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.238005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:53935)
0808 17:43:27.238189 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.238229 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:27.238678 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:27.238895 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:27.238899 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:27.239480 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:27.239665 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.239670 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.240292 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.240293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.241079 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.241081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.241374 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.241374 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.241474 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.241947 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:27.241955 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:27.243334 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:27.244618 (+ 1284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:27.244625 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:27.244627 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:27.244837 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:27.245016 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:27.245017 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:27.245017 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:27.245124 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:27.245362 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:27.245368 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:27.245500 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 17:43:27.245629 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 17:43:27.245801 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":81,"threads_started":1}
I20260808 17:43:27.246559 1908 heartbeater.cc:347] Connected to a master server at 127.9.187.254:38755
I20260808 17:43:27.246658 1908 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:27.246831 1908 heartbeater.cc:511] Master 127.9.187.254:38755 requested a full tablet report, sending...
I20260808 17:43:27.247196 1136 ts_manager.cc:194] Registered new tserver with Master: dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503)
I20260808 17:43:27.247550 1136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:53935
I20260808 17:43:27.251657 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.246272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54660 (local address 127.9.187.254:38755)
0808 17:43:27.246331 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:27.246333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:27.246342 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:43:27.246397 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:27.246398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:27.246408 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:27.246453 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:27.247033 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.247589 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.248319 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.248536 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.248587 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.249689 (+ 1102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:27.249690 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:27.249690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:27.249697 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:27.250672 (+ 975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:27.250972 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:27.250973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:27.250974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:27.251027 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:27.251188 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:27.251189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:27.251190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:27.251291 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:27.251467 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:27.251502 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 17:43:27.251568 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 17:43:27.253041 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:43:27.255587 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.253331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54674 (local address 127.9.187.254:38755)
0808 17:43:27.253368 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:27.253370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:27.253463 (+ 93us) server_negotiation.cc:407] Connection header received
0808 17:43:27.253534 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:27.253535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:27.253574 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:27.253632 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:43:27.253730 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.254232 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.254953 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.255155 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.255217 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.255357 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:43:27.255445 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:43:27.255505 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:27.255520 (+ 15us) server_negotiation.cc:299] Negotiation successful
0808 17:43:27.255534 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:43:27.255841 1136 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:54674:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:43:27.257418 1136 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:43:27.259656 1354 tablet_service.cc:1467] Processing CreateTablet for tablet 3d4fe002b6b940948f283ed21316a868 (DEFAULT_TABLE table=test-table [id=b97bef3f8f434e3ab9c791f9c760bb74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:27.259869 1354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d4fe002b6b940948f283ed21316a868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:27.261291 1285 tablet_bootstrap.cc:492] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: Bootstrap starting.
I20260808 17:43:27.261641 1285 tablet_bootstrap.cc:654] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:27.262221 1285 tablet_bootstrap.cc:492] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: No bootstrap required, opened a new log
I20260808 17:43:27.262274 1285 ts_tablet_manager.cc:1397] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 17:43:27.262387 1285 raft_consensus.cc:348] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:27.262463 1285 raft_consensus.cc:374] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:27.262513 1285 raft_consensus.cc:729] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c20f11e54b4e3f8ee88cf5328e79c1, State: Initialized, Role: FOLLOWER
I20260808 17:43:27.262565 1285 consensus_queue.cc:260] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:27.262658 1285 ts_tablet_manager.cc:1428] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.263468 1920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.259283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:42337 (local address 127.0.0.1:55892)
0808 17:43:27.259388 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.259396 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:27.259433 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:27.259820 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:27.259821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:27.259823 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:27.259852 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.259853 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.261168 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.261169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.262238 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.262242 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.263230 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.263231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.263293 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.263297 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:43:27.263351 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 17:43:27.263395 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":2,"thread_start_us":75,"threads_started":1}
I20260808 17:43:27.263533 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.259386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55892 (local address 127.9.187.194:42337)
0808 17:43:27.259558 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:27.259562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:27.259571 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:43:27.259605 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:27.259606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:27.259619 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:27.259698 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:27.259919 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.261085 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.262339 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.263082 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.263183 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.263245 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:27.263372 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 17:43:27.263453 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260808 17:43:27.263693 1475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.259184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:36503 (local address 127.0.0.1:52128)
0808 17:43:27.259229 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.259242 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:27.259290 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:27.259709 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:27.259710 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:27.259712 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:27.259750 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.259752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.261003 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.261004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.261857 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.261861 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.263479 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.263481 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.263545 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.263549 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:43:27.263579 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 17:43:27.263625 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":25}
I20260808 17:43:27.263993 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.259289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52128 (local address 127.9.187.195:36503)
0808 17:43:27.259539 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:27.259543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:27.259555 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:43:27.259593 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:27.259596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:27.259611 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:27.259702 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:27.259855 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.260895 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.261949 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.263391 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.263805 (+ 414us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.263874 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:27.263900 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 17:43:27.263932 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":89,"threads_started":1}
I20260808 17:43:27.264194 1586 tablet_service.cc:1467] Processing CreateTablet for tablet 3d4fe002b6b940948f283ed21316a868 (DEFAULT_TABLE table=test-table [id=b97bef3f8f434e3ab9c791f9c760bb74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:27.264561 1586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d4fe002b6b940948f283ed21316a868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:27.264689 1804 tablet_service.cc:1467] Processing CreateTablet for tablet 3d4fe002b6b940948f283ed21316a868 (DEFAULT_TABLE table=test-table [id=b97bef3f8f434e3ab9c791f9c760bb74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:27.265004 1804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d4fe002b6b940948f283ed21316a868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:27.268119 1929 tablet_bootstrap.cc:492] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7: Bootstrap starting.
I20260808 17:43:27.268445 1930 tablet_bootstrap.cc:492] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3: Bootstrap starting.
I20260808 17:43:27.268864 1929 tablet_bootstrap.cc:654] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:27.269084 1930 tablet_bootstrap.cc:654] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:27.269444 1929 log.cc:824] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:27.269665 1930 log.cc:824] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:27.270207 1929 tablet_bootstrap.cc:492] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7: No bootstrap required, opened a new log
I20260808 17:43:27.270270 1929 ts_tablet_manager.cc:1397] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:43:27.270422 1930 tablet_bootstrap.cc:492] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3: No bootstrap required, opened a new log
I20260808 17:43:27.270483 1930 ts_tablet_manager.cc:1397] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:43:27.271582 1929 raft_consensus.cc:348] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:27.271735 1929 raft_consensus.cc:374] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:27.271757 1929 raft_consensus.cc:729] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54952da7342d457b99fc627093abbea7, State: Initialized, Role: FOLLOWER
I20260808 17:43:27.271757 1930 raft_consensus.cc:348] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:27.271859 1929 consensus_queue.cc:260] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:27.271931 1930 raft_consensus.cc:374] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:27.271974 1930 raft_consensus.cc:729] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcd4128e560040ce86e195322db02de3, State: Initialized, Role: FOLLOWER
I20260808 17:43:27.272117 1929 ts_tablet_manager.cc:1428] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:43:27.272083 1930 consensus_queue.cc:260] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:27.272236 1696 heartbeater.cc:503] Master 127.9.187.254:38755 was elected leader, sending a full tablet report...
I20260808 17:43:27.272349 1908 heartbeater.cc:503] Master 127.9.187.254:38755 was elected leader, sending a full tablet report...
I20260808 17:43:27.272351 1930 ts_tablet_manager.cc:1428] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:43:27.306003 1474 raft_consensus.cc:482] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:43:27.306195 1474 raft_consensus.cc:504] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:27.306545 1474 leader_election.cc:288] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503), 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337)
I20260808 17:43:27.309178 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.306792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:44475 (local address 127.9.187.195:36503)
0808 17:43:27.306856 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:27.306858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:27.306869 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:43:27.306898 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:27.306899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:27.306907 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:27.306967 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:27.307096 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.307573 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.308482 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.308866 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.308929 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.308938 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:27.309068 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 17:43:27.309113 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 17:43:27.309198 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.306714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:36503 (local address 127.9.187.193:44475)
0808 17:43:27.306768 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.306779 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:27.306824 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:27.306977 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:27.306978 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:27.306980 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:27.307036 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.307038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.307644 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.307645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.308399 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.308401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.308935 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.308936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.309011 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.309013 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:43:27.309058 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:43:27.309100 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 17:43:27.309508 1834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d4fe002b6b940948f283ed21316a868" candidate_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcd4128e560040ce86e195322db02de3" is_pre_election: true
I20260808 17:43:27.309662 1940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.306820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:42337 (local address 127.9.187.193:33591)
0808 17:43:27.307004 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.307012 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:27.307060 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:27.307161 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:27.307161 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:27.307163 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:27.307512 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.307514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.308116 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.308117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.308843 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:27.308845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.309409 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.309410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:27.309485 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.309489 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:43:27.309534 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:43:27.309573 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":124,"threads_started":1}
I20260808 17:43:27.309649 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.306901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:33591 (local address 127.9.187.194:42337)
0808 17:43:27.306957 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:27.306958 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:27.307070 (+ 112us) server_negotiation.cc:407] Connection header received
0808 17:43:27.307101 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:27.307102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:27.307112 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:27.307159 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:27.307586 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.308040 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.308927 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.309334 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.309400 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.309408 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:27.309551 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 17:43:27.309587 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:43:27.309659 1834 raft_consensus.cc:2454] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c20f11e54b4e3f8ee88cf5328e79c1 in term 0.
I20260808 17:43:27.309888 1277 leader_election.cc:302] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c20f11e54b4e3f8ee88cf5328e79c1, dcd4128e560040ce86e195322db02de3; no voters:
I20260808 17:43:27.310009 1474 raft_consensus.cc:2781] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:43:27.310074 1474 raft_consensus.cc:482] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:43:27.310096 1474 raft_consensus.cc:3037] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:27.310824 1474 raft_consensus.cc:504] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:27.310937 1474 leader_election.cc:288] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 1 election: Requested vote from peers dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503), 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337)
I20260808 17:43:27.311116 1834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d4fe002b6b940948f283ed21316a868" candidate_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcd4128e560040ce86e195322db02de3"
I20260808 17:43:27.311131 1618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d4fe002b6b940948f283ed21316a868" candidate_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54952da7342d457b99fc627093abbea7" is_pre_election: true
I20260808 17:43:27.311201 1834 raft_consensus.cc:3037] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:27.311262 1618 raft_consensus.cc:2454] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c20f11e54b4e3f8ee88cf5328e79c1 in term 0.
I20260808 17:43:27.311390 1614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d4fe002b6b940948f283ed21316a868" candidate_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54952da7342d457b99fc627093abbea7"
I20260808 17:43:27.311458 1614 raft_consensus.cc:3037] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:27.312093 1834 raft_consensus.cc:2454] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c20f11e54b4e3f8ee88cf5328e79c1 in term 1.
I20260808 17:43:27.312253 1277 leader_election.cc:302] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c20f11e54b4e3f8ee88cf5328e79c1, dcd4128e560040ce86e195322db02de3; no voters:
I20260808 17:43:27.312290 1614 raft_consensus.cc:2454] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c20f11e54b4e3f8ee88cf5328e79c1 in term 1.
I20260808 17:43:27.312374 1474 raft_consensus.cc:2781] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:43:27.312553 1474 raft_consensus.cc:686] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 LEADER]: Becoming Leader. State: Replica: 20c20f11e54b4e3f8ee88cf5328e79c1, State: Running, Role: LEADER
I20260808 17:43:27.312638 1474 consensus_queue.cc:237] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:27.313383 1134 catalog_manager.cc:5495] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c20f11e54b4e3f8ee88cf5328e79c1 (127.9.187.193). New cstate: current_term: 1 leader_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } health_report { overall_health: HEALTHY } } }
I20260808 17:43:27.321738 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.319647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52812 (local address 127.9.187.193:32939)
0808 17:43:27.319695 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:27.319697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:27.319705 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:43:27.319759 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:27.319759 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:27.319774 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:27.319829 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:43:27.319915 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.320381 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.321065 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:27.321263 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:27.321315 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:27.321448 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:43:27.321541 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:43:27.321600 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:27.321648 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 17:43:27.321667 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:43:27.323050 1614 raft_consensus.cc:1261] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7 [term 1 FOLLOWER]: Refusing update from remote peer 20c20f11e54b4e3f8ee88cf5328e79c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:43:27.323074 1834 raft_consensus.cc:1261] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3 [term 1 FOLLOWER]: Refusing update from remote peer 20c20f11e54b4e3f8ee88cf5328e79c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:43:27.323339 1474 consensus_queue.cc:1035] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:43:27.323470 1942 consensus_queue.cc:1035] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:43:27.325861 1948 mvcc.cc:205] Tried to move back new op lower bound from 7316320285993017344 to 7316320285953183744. Current Snapshot: MvccSnapshot[applied={T|T < 7316320285993017344}]
I20260808 17:43:27.326087 1946 mvcc.cc:205] Tried to move back new op lower bound from 7316320285993017344 to 7316320285953183744. Current Snapshot: MvccSnapshot[applied={T|T < 7316320285993017344}]
I20260808 17:43:27.327674 1134 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:54674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:43:27.327757 1134 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:54674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:43:27.328352 1134 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Sending DeleteTablet for 3 replicas of tablet 3d4fe002b6b940948f283ed21316a868
I20260808 17:43:27.328629 1804 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d4fe002b6b940948f283ed21316a868 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:27 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:52128
I20260808 17:43:27.328650 1586 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d4fe002b6b940948f283ed21316a868 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:27 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:55892
I20260808 17:43:27.328679 1354 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d4fe002b6b940948f283ed21316a868 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:27 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:52798
I20260808 17:43:27.328764 1479 tablet_replica.cc:330] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: stopping tablet replica
I20260808 17:43:27.328771 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 1207
I20260808 17:43:27.328804 1479 raft_consensus.cc:2229] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:43:27.328873 1479 raft_consensus.cc:2258] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:43:27.337599 1963 tablet_replica.cc:330] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7: stopping tablet replica
I20260808 17:43:27.337725 1963 raft_consensus.cc:2229] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:43:27.337847 1963 raft_consensus.cc:2258] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:43:27.338006 1962 tablet_replica.cc:330] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3: stopping tablet replica
I20260808 17:43:27.338114 1962 raft_consensus.cc:2229] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:43:27.338248 1962 raft_consensus.cc:2258] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:43:27.338747 1962 ts_tablet_manager.cc:1905] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:43:27.338886 1963 ts_tablet_manager.cc:1905] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:43:27.340322 1962 ts_tablet_manager.cc:1918] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:43:27.340377 1963 ts_tablet_manager.cc:1918] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:43:27.340404 1962 log.cc:1196] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/3d4fe002b6b940948f283ed21316a868
I20260808 17:43:27.340440 1963 log.cc:1196] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/3d4fe002b6b940948f283ed21316a868
I20260808 17:43:27.340682 1962 ts_tablet_manager.cc:1939] T 3d4fe002b6b940948f283ed21316a868 P dcd4128e560040ce86e195322db02de3: Deleting consensus metadata
I20260808 17:43:27.340726 1963 ts_tablet_manager.cc:1939] T 3d4fe002b6b940948f283ed21316a868 P 54952da7342d457b99fc627093abbea7: Deleting consensus metadata
I20260808 17:43:27.341128 1108 catalog_manager.cc:4841] TS 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337): tablet 3d4fe002b6b940948f283ed21316a868 (table test-table [id=b97bef3f8f434e3ab9c791f9c760bb74]) successfully deleted
I20260808 17:43:27.341216 1108 catalog_manager.cc:4841] TS dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503): tablet 3d4fe002b6b940948f283ed21316a868 (table test-table [id=b97bef3f8f434e3ab9c791f9c760bb74]) successfully deleted
W20260808 17:43:27.343150 1108 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:32939 (error 108)
I20260808 17:43:27.343657 1475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.343519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:32939 (local address 127.0.0.1:52814)
0808 17:43:27.343572 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.343618 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:32939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 17:43:27.343643 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 1472
W20260808 17:43:27.355302 1108 catalog_manager.cc:4584] TS 20c20f11e54b4e3f8ee88cf5328e79c1 (127.9.187.193:32939): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3d4fe002b6b940948f283ed21316a868: Network error: Client connection negotiation failed: client connection to 127.9.187.193:32939: connect: Connection refused (error 111)
I20260808 17:43:27.360124 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 1701
I20260808 17:43:27.372740 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 1085
I20260808 17:43:27.379943 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:38755
--webserver_interface=127.9.187.254
--webserver_port=36419
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:38755
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:27.461239 1966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:27.461467 1966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:27.461488 1966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:27.462672 1966 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:43:27.462718 1966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:27.462730 1966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:27.462742 1966 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:43:27.462752 1966 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:43:27.464288 1966 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:38755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:38755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=36419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:27.464541 1966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:27.464774 1966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:27.469491 1973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:27.469624 1966 server_base.cc:1034] running on GCE node
W20260808 17:43:27.469491 1978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:27.469542 1971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:27.470001 1966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:27.470336 1966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:27.471475 1966 hybrid_clock.cc:648] HybridClock initialized: now 1786211007471462 us; error 30 us; skew 500 ppm
Aug 08 17:43:27 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211007, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:27.473865 1966 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:43:27.474354 1966 webserver.cc:460] Webserver started at http://127.9.187.254:36419/ using document root <none> and password file <none>
I20260808 17:43:27.474560 1966 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:27.474632 1966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:27.475963 1966 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:27.476569 1986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.476727 1966 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:43:27.476812 1966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "2ce1b2807d3c4b479161be9b5b127813"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "1435e8f2cbcfa71fdfe46de4a6f8353f"
server_key_iv: "2b3c9dc081a5593a8485512613f7d552"
server_key_version: "encryptionkey@0"
I20260808 17:43:27.477165 1966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:27.493453 1966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:27.495288 1966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:27.495426 1966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:27.499384 1966 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:38755
I20260808 17:43:27.499428 2066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:38755 every 8 connection(s)
I20260808 17:43:27.499782 1966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:43:27.501310 2069 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:43:27.501915 2069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Bootstrap starting.
I20260808 17:43:27.504884 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 1966
I20260808 17:43:27.505218 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:32939
--local_ip_for_outbound_sockets=127.9.187.193
--tserver_master_addrs=127.9.187.254:38755
--webserver_port=45987
--webserver_interface=127.9.187.193
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:43:27.511260 2069 log.cc:824] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:27.513391 2069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:43:27.513667 2069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813: Bootstrap complete.
I20260808 17:43:27.515826 2069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:27.516048 2069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce1b2807d3c4b479161be9b5b127813, State: Initialized, Role: FOLLOWER
I20260808 17:43:27.516194 2069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:27.516258 2069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:43:27.516299 2069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:43:27.516346 2069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 2 FOLLOWER]: Advancing to term 3
I20260808 17:43:27.517310 2069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:27.517402 2069 leader_election.cc:302] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ce1b2807d3c4b479161be9b5b127813; no voters:
I20260808 17:43:27.517560 2069 leader_election.cc:288] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 17:43:27.517618 2075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 17:43:27.517822 2075 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [term 3 LEADER]: Becoming Leader. State: Replica: 2ce1b2807d3c4b479161be9b5b127813, State: Running, Role: LEADER
I20260808 17:43:27.517827 2069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:43:27.518182 2075 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } }
I20260808 17:43:27.518486 2078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ce1b2807d3c4b479161be9b5b127813. Latest consensus state: current_term: 3 leader_uuid: "2ce1b2807d3c4b479161be9b5b127813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } } }
I20260808 17:43:27.518558 2078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:27.518687 2077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2ce1b2807d3c4b479161be9b5b127813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ce1b2807d3c4b479161be9b5b127813" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 38755 } } }
I20260808 17:43:27.518738 2077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ce1b2807d3c4b479161be9b5b127813 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:27.518940 2089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:43:27.519752 2089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:43:27.519860 2089 catalog_manager.cc:1259] Loaded cluster ID: 75ae85b8d5014584b167a12610330096
I20260808 17:43:27.519898 2089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 17:43:27.520272 2089 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fdf8753b9ad google::LogMessage::Fail() at ??:0
@ 0x7fdf8753e88a google::LogMessage::SendToLog() at ??:0
@ 0x7fdf8753b4de google::LogMessage::Flush() at ??:0
@ 0x7fdf8753ca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fdf8f4600f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fdf8f4698b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fdf894090d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fdf893fe954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fdf8a2626db start_thread at ??:0
@ 0x7fdf8603961f clone at ??:0
W20260808 17:43:27.602344 2073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:27.602538 2073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:27.602559 2073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:27.603674 2073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:27.603713 2073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:27.603737 2073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:43:27.605187 2073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:32939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=45987
--tserver_master_addrs=127.9.187.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:27.605412 2073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:27.605638 2073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:27.610549 2119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:27.610648 2120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:27.611025 2073 server_base.cc:1034] running on GCE node
W20260808 17:43:27.611271 2122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:27.611487 2073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:27.611753 2073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:27.612898 2073 hybrid_clock.cc:648] HybridClock initialized: now 1786211007612879 us; error 34 us; skew 500 ppm
Aug 08 17:43:27 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211007, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:27.615502 2073 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:43:27.615893 2073 webserver.cc:460] Webserver started at http://127.9.187.193:45987/ using document root <none> and password file <none>
I20260808 17:43:27.616086 2073 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:27.616135 2073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:27.617457 2073 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:43:27.618161 2137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.618345 2073 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:43:27.618429 2073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "20c20f11e54b4e3f8ee88cf5328e79c1"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "7b78cf0edd0aa39e6c6eefd00a94c32d"
server_key_iv: "ba7edb0b8c3506ab940a24615015c225"
server_key_version: "encryptionkey@0"
I20260808 17:43:27.618752 2073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:27.641498 2073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:27.643785 2073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:27.643942 2073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:27.644189 2073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:27.644657 2147 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 17:43:27.646723 2073 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 17:43:27.646770 2073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 17:43:27.646806 2073 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 17:43:27.647449 2073 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 17:43:27.647482 2073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 17:43:27.647583 2147 tablet_bootstrap.cc:492] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: Bootstrap starting.
I20260808 17:43:27.654099 2073 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:32939
I20260808 17:43:27.654270 2310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:32939 every 8 connection(s)
I20260808 17:43:27.654539 2073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:43:27.658759 2147 log.cc:824] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:27.661470 2147 tablet_bootstrap.cc:492] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:43:27.661648 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 2073
I20260808 17:43:27.661808 2147 tablet_bootstrap.cc:492] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: Bootstrap complete.
I20260808 17:43:27.661924 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:42337
--local_ip_for_outbound_sockets=127.9.187.194
--tserver_master_addrs=127.9.187.254:38755
--webserver_port=44523
--webserver_interface=127.9.187.194
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:43:27.662946 2147 ts_tablet_manager.cc:1397] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.010s
I20260808 17:43:27.664336 2147 raft_consensus.cc:348] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:27.664688 2147 raft_consensus.cc:729] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c20f11e54b4e3f8ee88cf5328e79c1, State: Initialized, Role: FOLLOWER
I20260808 17:43:27.664855 2147 consensus_queue.cc:260] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:27.665145 2147 ts_tablet_manager.cc:1428] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
W20260808 17:43:27.716408 2313 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:43:27.655235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:50555)
0808 17:43:27.655414 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.655450 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:27.655962 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:27.716199 (+ 60237us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":104,"threads_started":1}
W20260808 17:43:27.716693 2311 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:38755 (0 consecutive failures): Network error: Failed to ping master at 127.9.187.254:38755: Client connection negotiation failed: client connection to 127.9.187.254:38755: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 17:43:27.717056 2313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.716944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:42941)
0808 17:43:27.716990 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.717033 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 17:43:27.717440 2313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.717356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:55541)
0808 17:43:27.717400 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.717424 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 17:43:27.717566 2311 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:43:27.762737 2317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:27.762946 2317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:27.762969 2317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:27.764111 2317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:27.764151 2317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:27.764175 2317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:43:27.765583 2317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:42337
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=44523
--tserver_master_addrs=127.9.187.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:27.765808 2317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:27.765995 2317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:27.770732 2326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:27.770727 2327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:27.770727 2330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:27.770855 2317 server_base.cc:1034] running on GCE node
I20260808 17:43:27.771131 2317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:27.771349 2317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:27.772477 2317 hybrid_clock.cc:648] HybridClock initialized: now 1786211007772468 us; error 27 us; skew 500 ppm
Aug 08 17:43:27 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211007, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:27.774891 2317 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:43:27.775267 2317 webserver.cc:460] Webserver started at http://127.9.187.194:44523/ using document root <none> and password file <none>
I20260808 17:43:27.775447 2317 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:27.775486 2317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:27.776661 2317 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:43:27.777191 2342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.777339 2317 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.777422 2317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "54952da7342d457b99fc627093abbea7"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "080bbea09f6fa0674093e4862e1a8102"
server_key_iv: "60db36dc2d8a965fb93c15cc1ada1246"
server_key_version: "encryptionkey@0"
I20260808 17:43:27.777746 2317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:27.787022 2317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:27.788676 2317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:27.788812 2317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:27.789012 2317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:27.789304 2317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:27.789340 2317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.789368 2317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:27.789386 2317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.795073 2317 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:42337
I20260808 17:43:27.795135 2514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:42337 every 8 connection(s)
I20260808 17:43:27.795446 2317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:43:27.796380 2518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.796025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:47237)
0808 17:43:27.796167 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.796244 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":73,"threads_started":1}
W20260808 17:43:27.796757 2515 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:38755 (0 consecutive failures): Network error: Failed to ping master at 127.9.187.254:38755: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
I20260808 17:43:27.796980 2518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.796902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:40561)
0808 17:43:27.796938 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.796962 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 17:43:27.797189 2518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.797129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:41407)
0808 17:43:27.797158 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.797175 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 17:43:27.797267 2515 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 17:43:27.803155 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 2317
I20260808 17:43:27.803382 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:36503
--local_ip_for_outbound_sockets=127.9.187.195
--tserver_master_addrs=127.9.187.254:38755
--webserver_port=45197
--webserver_interface=127.9.187.195
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:27.884459 2519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:27.884660 2519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:27.884699 2519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:27.885845 2519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:27.885885 2519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:27.885919 2519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:43:27.887363 2519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:36503
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=45197
--tserver_master_addrs=127.9.187.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:27.887590 2519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:27.887816 2519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:27.892464 2531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:27.892478 2529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:27.892486 2528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:27.892755 2519 server_base.cc:1034] running on GCE node
I20260808 17:43:27.892958 2519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:27.893177 2519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:27.894309 2519 hybrid_clock.cc:648] HybridClock initialized: now 1786211007894296 us; error 30 us; skew 500 ppm
Aug 08 17:43:27 dist-test-slave-bqcl krb5kdc[32687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211007, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:27.896708 2519 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:43:27.897138 2519 webserver.cc:460] Webserver started at http://127.9.187.195:45197/ using document root <none> and password file <none>
I20260808 17:43:27.897353 2519 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:27.897404 2519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:27.898729 2519 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:27.899323 2539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.899494 2519 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:43:27.899576 2519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "dcd4128e560040ce86e195322db02de3"
format_stamp: "Formatted at 2026-08-08 17:43:26 on dist-test-slave-bqcl"
server_key: "25033c695d6e659a81364195c7567043"
server_key_iv: "d48af2891772a01c26c49668b4734382"
server_key_version: "encryptionkey@0"
I20260808 17:43:27.899890 2519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:27.913465 2519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:27.915160 2519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:27.915290 2519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:27.915486 2519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:27.915767 2519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:27.915802 2519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.915830 2519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:27.915853 2519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:27.921185 2519 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:36503
I20260808 17:43:27.921244 2715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:36503 every 8 connection(s)
I20260808 17:43:27.921553 2519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:43:27.922642 2719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.922224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:59519)
0808 17:43:27.922385 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.922487 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":66,"threads_started":1}
W20260808 17:43:27.923032 2717 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:38755 (0 consecutive failures): Network error: Failed to ping master at 127.9.187.254:38755: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
I20260808 17:43:27.923293 2719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.923203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:38127)
0808 17:43:27.923239 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.923270 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 17:43:27.923518 2719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:27.923461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:44721)
0808 17:43:27.923484 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:27.923505 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260808 17:43:27.923609 2717 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 17:43:27.928620 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 2519
I20260808 17:43:28.718189 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:28.717915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:34243)
0808 17:43:28.718042 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:28.718076 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
I20260808 17:43:28.797797 2723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:28.797560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:35501)
0808 17:43:28.797704 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:28.797739 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
I20260808 17:43:28.924098 2724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:28.923895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:41279)
0808 17:43:28.924012 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:28.924047 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":61,"threads_started":1}
I20260808 17:43:29.333696 2725 raft_consensus.cc:482] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:43:29.333824 2725 raft_consensus.cc:504] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:29.334201 2725 leader_election.cc:288] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503), 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337)
Aug 08 17:43:29 dist-test-slave-bqcl krb5kdc[32687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211007, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.195@KRBTEST.COM
Aug 08 17:43:29 dist-test-slave-bqcl krb5kdc[32687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211007, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.194@KRBTEST.COM
I20260808 17:43:29.348090 2728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:29.334446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:45573 (local address 127.9.187.195:36503)
0808 17:43:29.334675 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:29.334703 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:29.334742 (+ 39us) server_negotiation.cc:407] Connection header received
0808 17:43:29.335179 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:29.335182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:29.335222 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:29.335342 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:29.336111 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:29.336974 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:29.337963 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:29.338393 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:29.338493 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:29.344490 (+ 5997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:29.344494 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:29.344494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:29.344504 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:29.346308 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:29.346786 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:29.346789 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:29.346790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:29.346882 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:29.347168 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:29.347169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:29.347170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:29.347458 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:29.347538 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:29.347862 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 17:43:29.347971 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":57,"threads_started":1}
I20260808 17:43:29.348114 2727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:29.334371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:36503 (local address 127.9.187.193:45573)
0808 17:43:29.334588 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:29.334600 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:29.334670 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:29.335404 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:29.335407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:29.335818 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:29.335999 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:29.336005 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:29.337069 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:29.337070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:29.337883 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:29.337886 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:29.338476 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:29.338477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:29.338586 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:29.342833 (+ 4247us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:29.342844 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:29.344383 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:29.346390 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:29.346397 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:29.346400 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:29.346697 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:29.346949 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:29.346950 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:29.346950 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:29.347104 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:29.347530 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:29.347537 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:29.347690 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 17:43:29.347818 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 17:43:29.347987 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":46,"thread_start_us":51,"threads_started":1}
I20260808 17:43:29.348388 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:29.334681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:45973 (local address 127.9.187.194:42337)
0808 17:43:29.334818 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:29.334826 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:29.334844 (+ 18us) server_negotiation.cc:407] Connection header received
0808 17:43:29.335247 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:29.335249 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:29.335284 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:29.335436 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:29.336110 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:29.336962 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:29.337965 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:29.338393 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:29.338492 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:29.344913 (+ 6421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:29.344918 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:29.344918 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:29.344931 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:29.346974 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:29.347343 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:29.347346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:29.347346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:29.347437 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:29.347629 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:29.347630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:29.347630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:29.347927 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:29.348016 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:29.348193 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 17:43:29.348314 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":58,"threads_started":1}
I20260808 17:43:29.348464 2731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:29.334517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:42337 (local address 127.9.187.193:45973)
0808 17:43:29.334623 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:29.334633 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:29.334686 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:29.335441 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:29.335442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:29.335817 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:29.335999 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:29.336005 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:29.337054 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:29.337056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:29.337884 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:29.337887 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:29.338475 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:29.338476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:29.338588 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:29.342834 (+ 4246us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:29.342844 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:29.344773 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:29.347061 (+ 2288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:29.347062 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:29.347062 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:29.347264 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:29.347499 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:29.347500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:29.347500 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:29.347570 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:29.348002 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:29.348004 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:29.348049 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 17:43:29.348123 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 17:43:29.348375 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":45,"thread_start_us":56,"threads_started":1}
W20260808 17:43:29.349287 2139 leader_election.cc:341] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337): Not found: Tablet not found: 3d4fe002b6b940948f283ed21316a868
W20260808 17:43:29.349493 2139 leader_election.cc:341] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503): Not found: Tablet not found: 3d4fe002b6b940948f283ed21316a868
I20260808 17:43:29.349539 2139 leader_election.cc:302] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c20f11e54b4e3f8ee88cf5328e79c1; no voters: 54952da7342d457b99fc627093abbea7, dcd4128e560040ce86e195322db02de3
I20260808 17:43:29.349673 2725 raft_consensus.cc:2726] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:43:29.718744 2731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:29.718594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:51169)
0808 17:43:29.718663 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:29.718700 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 17:43:29.798381 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:29.798190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:60141)
0808 17:43:29.798295 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:29.798336 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":58,"threads_started":1}
I20260808 17:43:29.924715 2735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:29.924493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:50581)
0808 17:43:29.924635 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:29.924667 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
I20260808 17:43:30.719344 2736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:30.719139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:41617)
0808 17:43:30.719265 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:30.719297 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":62,"threads_started":1}
I20260808 17:43:30.799062 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:30.798816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:35313)
0808 17:43:30.798950 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:30.799016 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260808 17:43:30.925370 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:30.925101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:34729)
0808 17:43:30.925288 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:30.925326 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":89,"threads_started":1}
I20260808 17:43:31.480675 2740 raft_consensus.cc:482] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:43:31.480782 2740 raft_consensus.cc:504] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:31.480943 2740 leader_election.cc:288] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503), 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337)
W20260808 17:43:31.481359 2139 leader_election.cc:341] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503): Not found: Tablet not found: 3d4fe002b6b940948f283ed21316a868
W20260808 17:43:31.481436 2139 leader_election.cc:341] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337): Not found: Tablet not found: 3d4fe002b6b940948f283ed21316a868
I20260808 17:43:31.481493 2139 leader_election.cc:302] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c20f11e54b4e3f8ee88cf5328e79c1; no voters: 54952da7342d457b99fc627093abbea7, dcd4128e560040ce86e195322db02de3
I20260808 17:43:31.481611 2740 raft_consensus.cc:2726] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:43:31.720003 2744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:31.719771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:59945)
0808 17:43:31.719901 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:31.719938 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":79,"threads_started":1}
I20260808 17:43:31.799690 2745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:31.799466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:33305)
0808 17:43:31.799598 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:31.799633 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":61,"threads_started":1}
I20260808 17:43:31.925988 2746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:31.925773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:45837)
0808 17:43:31.925898 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:31.925933 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":60,"threads_started":1}
I20260808 17:43:32.720647 2748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:32.720452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:45019)
0808 17:43:32.720568 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:32.720598 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":66,"threads_started":1}
I20260808 17:43:32.800258 2749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:32.800054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:39377)
0808 17:43:32.800179 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:32.800217 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":58,"threads_started":1}
I20260808 17:43:32.926712 2750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:32.926409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:59471)
0808 17:43:32.926600 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:32.926649 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":104,"threads_started":1}
I20260808 17:43:33.721376 2751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:33.721095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:36405)
0808 17:43:33.721262 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:33.721304 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":90,"threads_started":1}
I20260808 17:43:33.801144 2755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:33.800818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:58981)
0808 17:43:33.800989 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:33.801055 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":91,"threads_started":1}
I20260808 17:43:33.875517 2756 raft_consensus.cc:482] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:43:33.875618 2756 raft_consensus.cc:504] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:33.875787 2756 leader_election.cc:288] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503), 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337)
W20260808 17:43:33.876211 2139 leader_election.cc:341] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337): Not found: Tablet not found: 3d4fe002b6b940948f283ed21316a868
W20260808 17:43:33.876286 2139 leader_election.cc:341] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503): Not found: Tablet not found: 3d4fe002b6b940948f283ed21316a868
I20260808 17:43:33.876312 2139 leader_election.cc:302] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c20f11e54b4e3f8ee88cf5328e79c1; no voters: 54952da7342d457b99fc627093abbea7, dcd4128e560040ce86e195322db02de3
I20260808 17:43:33.876394 2756 raft_consensus.cc:2726] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:43:33.927384 2758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:33.927193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:41057)
0808 17:43:33.927308 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:33.927341 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260808 17:43:34.722038 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:34.721818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:50411)
0808 17:43:34.721942 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:34.721985 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260808 17:43:34.801795 2760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:34.801592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:46797)
0808 17:43:34.801718 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:34.801753 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":59,"threads_started":1}
I20260808 17:43:34.927971 2761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:34.927765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:56917)
0808 17:43:34.927892 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:34.927928 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":55,"threads_started":1}
I20260808 17:43:35.722641 2763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:35.722451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:43711)
0808 17:43:35.722563 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:35.722595 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":62,"threads_started":1}
I20260808 17:43:35.802444 2764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:35.802254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:34505)
0808 17:43:35.802365 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:35.802399 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":64,"threads_started":1}
I20260808 17:43:35.928646 2765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:35.928369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:42277)
0808 17:43:35.928562 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:35.928600 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":61,"threads_started":1}
I20260808 17:43:36.655773 2766 raft_consensus.cc:482] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:43:36.655864 2766 raft_consensus.cc:504] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:36.656011 2766 leader_election.cc:288] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503), 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337)
W20260808 17:43:36.656373 2139 leader_election.cc:341] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337): Not found: Tablet not found: 3d4fe002b6b940948f283ed21316a868
W20260808 17:43:36.656431 2139 leader_election.cc:341] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503): Not found: Tablet not found: 3d4fe002b6b940948f283ed21316a868
I20260808 17:43:36.656445 2139 leader_election.cc:302] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c20f11e54b4e3f8ee88cf5328e79c1; no voters: 54952da7342d457b99fc627093abbea7, dcd4128e560040ce86e195322db02de3
I20260808 17:43:36.656525 2766 raft_consensus.cc:2726] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:43:36.723261 2767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:36.723049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:49677)
0808 17:43:36.723172 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:36.723210 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
I20260808 17:43:36.803045 2769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:36.802826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:49425)
0808 17:43:36.802963 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:36.802999 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":80,"threads_started":1}
I20260808 17:43:36.929304 2770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:36.929088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:33521)
0808 17:43:36.929212 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:36.929255 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260808 17:43:37.723881 2771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:37.723654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:45431)
0808 17:43:37.723795 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:37.723831 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260808 17:43:37.803687 2773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:37.803451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:56139)
0808 17:43:37.803603 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:37.803640 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":85,"threads_started":1}
I20260808 17:43:37.929859 2774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:37.929658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:39391)
0808 17:43:37.929785 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:37.929818 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260808 17:43:38.724457 2775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:38.724251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:40221)
0808 17:43:38.724373 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:38.724407 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260808 17:43:38.804322 2777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:38.804096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:46751)
0808 17:43:38.804239 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:38.804271 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260808 17:43:38.930536 2779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:38.930325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:60121)
0808 17:43:38.930454 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:38.930491 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":61,"threads_started":1}
I20260808 17:43:39.725092 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:39.724872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:46243)
0808 17:43:39.725007 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:39.725042 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260808 17:43:39.804893 2781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:39.804703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:60803)
0808 17:43:39.804816 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:39.804846 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":63,"threads_started":1}
I20260808 17:43:39.931211 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:39.930978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:53175)
0808 17:43:39.931120 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:39.931156 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":75,"threads_started":1}
I20260808 17:43:40.725723 2784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:40.725517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:58907)
0808 17:43:40.725639 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:40.725674 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
I20260808 17:43:40.805533 2785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:40.805324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:47985)
0808 17:43:40.805454 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:40.805489 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
I20260808 17:43:40.931864 2787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:40.931645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:37247)
0808 17:43:40.931782 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:40.931819 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260808 17:43:41.726305 2788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:41.726080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:48357)
0808 17:43:41.726217 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:41.726256 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260808 17:43:41.806159 2789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:41.805929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:36597)
0808 17:43:41.806050 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:41.806085 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260808 17:43:41.932541 2793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:41.932310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:45861)
0808 17:43:41.932451 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:41.932489 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":61,"threads_started":1}
I20260808 17:43:42.727059 2794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:42.726848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.193:44977)
0808 17:43:42.726978 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:42.727010 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
I20260808 17:43:42.798779 2795 raft_consensus.cc:482] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:43:42.798869 2795 raft_consensus.cc:504] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd4128e560040ce86e195322db02de3" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 36503 } } peers { permanent_uuid: "54952da7342d457b99fc627093abbea7" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 42337 } } peers { permanent_uuid: "20c20f11e54b4e3f8ee88cf5328e79c1" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32939 } }
I20260808 17:43:42.799000 2795 leader_election.cc:288] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503), 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337)
W20260808 17:43:42.799366 2139 leader_election.cc:341] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 54952da7342d457b99fc627093abbea7 (127.9.187.194:42337): Not found: Tablet not found: 3d4fe002b6b940948f283ed21316a868
W20260808 17:43:42.799437 2139 leader_election.cc:341] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dcd4128e560040ce86e195322db02de3 (127.9.187.195:36503): Not found: Tablet not found: 3d4fe002b6b940948f283ed21316a868
I20260808 17:43:42.799453 2139 leader_election.cc:302] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c20f11e54b4e3f8ee88cf5328e79c1; no voters: 54952da7342d457b99fc627093abbea7, dcd4128e560040ce86e195322db02de3
I20260808 17:43:42.799521 2795 raft_consensus.cc:2726] T 3d4fe002b6b940948f283ed21316a868 P 20c20f11e54b4e3f8ee88cf5328e79c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:43:42.806746 2797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:42.806545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.194:57433)
0808 17:43:42.806672 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:42.806704 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":67,"threads_started":1}
I20260808 17:43:42.929008 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 2073
I20260808 17:43:42.938903 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:42.935665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:38755 (local address 127.9.187.195:48969)
0808 17:43:42.938802 (+ 3137us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:42.938844 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:38755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3117,"thread_start_us":1548,"threads_started":1}
I20260808 17:43:42.946887 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 2317
I20260808 17:43:42.964715 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 2519
2026-08-08T17:43:42Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18251 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:43:43 dist-test-slave-bqcl krb5kdc[2801](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:43:43 dist-test-slave-bqcl krb5kdc[2801](info): set up 2 sockets
Aug 08 17:43:43 dist-test-slave-bqcl krb5kdc[2801](info): commencing operation
krb5kdc: starting...
W20260808 17:43:44.107798 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:43:44 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:43:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:43:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:43:44.224539 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46251
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:46251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:44.304147 2821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:44.304340 2821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:44.304361 2821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:44.305451 2821 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 17:43:44.305488 2821 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 17:43:44.305508 2821 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 17:43:44.305518 2821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:43:44.305531 2821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:44.305541 2821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:44.305552 2821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:43:44.305562 2821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:43:44.306974 2821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:46251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:44.307170 2821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:44.307341 2821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:44.311767 2829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:44.311828 2830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:44.311889 2821 server_base.cc:1034] running on GCE node
W20260808 17:43:44.311775 2832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:44.312235 2821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:44.312525 2821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:44.313665 2821 hybrid_clock.cc:648] HybridClock initialized: now 1786211024313648 us; error 32 us; skew 500 ppm
Aug 08 17:43:44 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211024, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:44.315996 2821 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:43:44.316386 2821 webserver.cc:460] Webserver started at http://127.9.187.254:45613/ using document root <none> and password file <none>
I20260808 17:43:44.316596 2821 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:44.316644 2821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:44.316779 2821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:44.317770 2821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "f5058378d4d34b4b933a31e33bc1b002"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "a7b8edce55f4ab1b81fb99165c5cdcaa"
server_key_iv: "b5425115730704bdce4d8c03a60db5e8"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.318099 2821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "f5058378d4d34b4b933a31e33bc1b002"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "a7b8edce55f4ab1b81fb99165c5cdcaa"
server_key_iv: "b5425115730704bdce4d8c03a60db5e8"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.319401 2821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:44.320057 2841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:44.320212 2821 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:43:44.320297 2821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "f5058378d4d34b4b933a31e33bc1b002"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "a7b8edce55f4ab1b81fb99165c5cdcaa"
server_key_iv: "b5425115730704bdce4d8c03a60db5e8"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.320363 2821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:44.346180 2821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:44.347919 2821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:44.348054 2821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:44.351837 2821 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:46251
I20260808 17:43:44.351877 2926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:46251 every 8 connection(s)
I20260808 17:43:44.352202 2821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:43:44.353084 2927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:44.355540 2927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Bootstrap starting.
I20260808 17:43:44.356158 2927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:44.356451 2927 log.cc:824] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:44.357111 2927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: No bootstrap required, opened a new log
I20260808 17:43:44.358788 2927 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:43:44.358930 2927 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:44.358968 2927 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5058378d4d34b4b933a31e33bc1b002, State: Initialized, Role: FOLLOWER
I20260808 17:43:44.359133 2927 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:43:44.359220 2927 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:43:44.359261 2927 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:43:44.359314 2927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:44.359843 2927 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:43:44.359944 2927 leader_election.cc:302] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5058378d4d34b4b933a31e33bc1b002; no voters:
I20260808 17:43:44.360132 2927 leader_election.cc:288] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:43:44.360172 2932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:43:44.360324 2932 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 1 LEADER]: Becoming Leader. State: Replica: f5058378d4d34b4b933a31e33bc1b002, State: Running, Role: LEADER
I20260808 17:43:44.360399 2927 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:43:44.360438 2932 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:43:44.360993 2934 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5058378d4d34b4b933a31e33bc1b002" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } } }
I20260808 17:43:44.360999 2937 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5058378d4d34b4b933a31e33bc1b002. Latest consensus state: current_term: 1 leader_uuid: "f5058378d4d34b4b933a31e33bc1b002" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } } }
I20260808 17:43:44.361099 2934 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:44.361109 2937 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: This master's current role is: LEADER
I20260808 17:43:44.361307 2948 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:43:44.361840 2948 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:43:44.361967 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 2821
I20260808 17:43:44.362090 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:43:44.362330 9967 external_mini_cluster.cc:1428] Setting key 8d92c7e47fde8131abd1b33c7676f680
I20260808 17:43:44.363927 2948 catalog_manager.cc:1347] Generated new cluster ID: 3c5cefc3c0be4e1181e967c972d3f3c9
I20260808 17:43:44.363983 2948 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:43:44 dist-test-slave-bqcl krb5kdc[2801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:44.373917 2960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.362793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39100 (local address 127.9.187.254:46251)
0808 17:43:44.362955 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:44.362964 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:44.363151 (+ 187us) server_negotiation.cc:407] Connection header received
0808 17:43:44.363325 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:44.363331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:44.363376 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:44.363493 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:44.364291 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.365465 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.366474 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.367102 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.367218 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.369867 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:44.369871 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:44.369872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:44.369884 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:44.372364 (+ 2480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:44.372739 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:44.372742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:44.372742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:44.372839 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:44.373041 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:44.373042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:44.373042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:44.373338 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:44.373464 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:44.373587 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 17:43:44.373713 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
I20260808 17:43:44.377616 2948 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:43:44.378083 2948 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:43:44.383703 2948 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Generated new TSK 0
I20260808 17:43:44.383842 2948 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:43:44.413089 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:46251
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:44.493496 2964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:44.493690 2964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:44.493711 2964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:44.494844 2964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:44.494884 2964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:44.494908 2964 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:43:44.496310 2964 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:46251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:44.496531 2964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:44.496750 2964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:44.501482 2972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:44.501487 2975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:44.501601 2964 server_base.cc:1034] running on GCE node
W20260808 17:43:44.501503 2970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:44.501904 2964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:44.502139 2964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:44.503280 2964 hybrid_clock.cc:648] HybridClock initialized: now 1786211024503263 us; error 33 us; skew 500 ppm
Aug 08 17:43:44 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211024, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:44.508479 2964 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:43:44.508901 2964 webserver.cc:460] Webserver started at http://127.9.187.193:39213/ using document root <none> and password file <none>
I20260808 17:43:44.509121 2964 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:44.509171 2964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:44.509295 2964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:44.510324 2964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "b04d4c28162742ac9f424be01476586f"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "821b23597478ee4f78d5716867c7771d"
server_key_iv: "5ea0567c4397b2a228aace95405c303e"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.510658 2964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "b04d4c28162742ac9f424be01476586f"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "821b23597478ee4f78d5716867c7771d"
server_key_iv: "5ea0567c4397b2a228aace95405c303e"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.511875 2964 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:43:44.512578 2985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:44.512738 2964 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:43:44.512820 2964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "b04d4c28162742ac9f424be01476586f"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "821b23597478ee4f78d5716867c7771d"
server_key_iv: "5ea0567c4397b2a228aace95405c303e"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.512878 2964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:44.522642 2964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:44.524582 2964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:44.524706 2964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:44.524894 2964 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:44.525187 2964 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:44.525223 2964 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:44.525265 2964 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:44.525290 2964 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:44.530826 2964 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:44483
I20260808 17:43:44.530864 3165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:44483 every 8 connection(s)
I20260808 17:43:44.531150 2964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:43:44 dist-test-slave-bqcl krb5kdc[2801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211024, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:44.537935 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 2964
I20260808 17:43:44.538053 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:43:44.538276 9967 external_mini_cluster.cc:1428] Setting key a83109735e52c46552ff5b424ded5d37
I20260808 17:43:44.539942 2960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.531798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:39151 (local address 127.9.187.254:46251)
0808 17:43:44.531845 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:44.531848 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:44.532061 (+ 213us) server_negotiation.cc:407] Connection header received
0808 17:43:44.532504 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:44.532505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:44.532520 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:44.532561 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:44.533442 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.533927 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.534925 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.535141 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.535195 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.537194 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:44.537195 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:44.537195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:44.537202 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:44.538528 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:44.539012 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:44.539012 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:44.539013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:44.539093 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:44.539326 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:44.539327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:44.539327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:44.539447 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:44.539511 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:44.539769 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 17:43:44.539855 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:43:44.540022 3168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.531783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:39151)
0808 17:43:44.531946 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:44.531980 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:44.532418 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:44.532642 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:44.532645 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:44.533193 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:44.533375 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.533380 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.534001 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.534002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.534854 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.534856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.535216 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.535217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.535316 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.535760 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:44.535767 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:44.537096 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:44.538617 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:44.538625 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:44.538628 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:44.538921 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:44.539158 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:44.539158 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:44.539159 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:44.539267 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:44.539535 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:44.539538 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:44.539649 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 17:43:44.539734 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 17:43:44.539855 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
I20260808 17:43:44.541337 3166 heartbeater.cc:347] Connected to a master server at 127.9.187.254:46251
I20260808 17:43:44.541425 3166 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:44.541589 3166 heartbeater.cc:511] Master 127.9.187.254:46251 requested a full tablet report, sending...
I20260808 17:43:44.542158 2865 ts_manager.cc:194] Registered new tserver with Master: b04d4c28162742ac9f424be01476586f (127.9.187.193:44483)
I20260808 17:43:44.542804 2865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:39151
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:43:44.563017 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:46251
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:44.641716 3171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:44.641903 3171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:44.641934 3171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:44.643045 3171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:44.643087 3171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:44.643121 3171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:43:44.644511 3171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:46251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:44.644742 3171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:44.644939 3171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:43:44.649856 3171 server_base.cc:1034] running on GCE node
W20260808 17:43:44.649794 3179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:44.649794 3185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:44.649821 3182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:44.650207 3171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:44.650434 3171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:44.651587 3171 hybrid_clock.cc:648] HybridClock initialized: now 1786211024651572 us; error 29 us; skew 500 ppm
Aug 08 17:43:44 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211024, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:44.654033 3171 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:43:44.654466 3171 webserver.cc:460] Webserver started at http://127.9.187.194:42281/ using document root <none> and password file <none>
I20260808 17:43:44.654690 3171 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:44.654739 3171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:44.654868 3171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:44.655880 3171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "c417502da8164ae18e15d8d3aa043cc3"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "1f7bd115e7eb480ece093cdf2aeba732"
server_key_iv: "c17a9e2e23244a093b3a55fe2944dd29"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.656208 3171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "c417502da8164ae18e15d8d3aa043cc3"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "1f7bd115e7eb480ece093cdf2aeba732"
server_key_iv: "c17a9e2e23244a093b3a55fe2944dd29"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.657498 3171 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:43:44.658358 3197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:44.658521 3171 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:43:44.658618 3171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "c417502da8164ae18e15d8d3aa043cc3"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "1f7bd115e7eb480ece093cdf2aeba732"
server_key_iv: "c17a9e2e23244a093b3a55fe2944dd29"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.658679 3171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:44.673791 3171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:44.675750 3171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:44.675886 3171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:44.676105 3171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:44.676402 3171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:44.676436 3171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:44.676467 3171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:44.676491 3171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:44.682297 3171 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:36771
I20260808 17:43:44.682358 3374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:36771 every 8 connection(s)
I20260808 17:43:44.682660 3171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:43:44.687558 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 3171
I20260808 17:43:44.687646 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:43:44.687811 9967 external_mini_cluster.cc:1428] Setting key 3551fb3fcdc16224e42316f500c18d18
Aug 08 17:43:44 dist-test-slave-bqcl krb5kdc[2801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211024, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:44.691854 2960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.683354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:56561 (local address 127.9.187.254:46251)
0808 17:43:44.683403 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:44.683405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:44.683640 (+ 235us) server_negotiation.cc:407] Connection header received
0808 17:43:44.684062 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:44.684063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:44.684074 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:44.684134 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:44.685014 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.685521 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.686609 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.686805 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.686855 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.689022 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:44.689024 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:44.689025 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:44.689033 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:44.690425 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:44.690890 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:44.690891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:44.690891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:44.690953 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:44.691198 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:44.691198 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:44.691199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:44.691327 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:44.691387 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:44.691683 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 17:43:44.691767 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:43:44.691913 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.683316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:56561)
0808 17:43:44.683476 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:44.683520 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:44.683984 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:44.684197 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:44.684200 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:44.684755 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:44.684945 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.684950 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.685586 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.685587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.686504 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.686507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.686866 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.686867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.686959 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.687448 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:44.687457 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:44.688936 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:44.690495 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:44.690502 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:44.690504 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:44.690820 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:44.691012 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:44.691012 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:44.691012 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:44.691142 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:44.691418 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:44.691425 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:44.691543 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 17:43:44.691634 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 17:43:44.691752 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":72,"threads_started":1}
I20260808 17:43:44.692394 3375 heartbeater.cc:347] Connected to a master server at 127.9.187.254:46251
I20260808 17:43:44.692492 3375 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:44.692677 3375 heartbeater.cc:511] Master 127.9.187.254:46251 requested a full tablet report, sending...
I20260808 17:43:44.693074 2865 ts_manager.cc:194] Registered new tserver with Master: c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771)
I20260808 17:43:44.693547 2865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:56561
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:43:44.718892 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:46251
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:43:44.798736 3383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:43:44.798929 3383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:43:44.798950 3383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:43:44.800035 3383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:43:44.800074 3383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:43:44.800101 3383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:43:44.801532 3383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:46251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:43:44.801775 3383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:43:44.802028 3383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:43:44.806758 3396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:44.806783 3401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:43:44.806788 3395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:43:44.806860 3383 server_base.cc:1034] running on GCE node
I20260808 17:43:44.807140 3383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:43:44.807366 3383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:43:44.808498 3383 hybrid_clock.cc:648] HybridClock initialized: now 1786211024808484 us; error 30 us; skew 500 ppm
Aug 08 17:43:44 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211024, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:43:44.810890 3383 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:43:44.811307 3383 webserver.cc:460] Webserver started at http://127.9.187.195:45209/ using document root <none> and password file <none>
I20260808 17:43:44.811498 3383 fs_manager.cc:359] Metadata directory not provided
I20260808 17:43:44.811546 3383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:43:44.811677 3383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:43:44.812659 3383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "fffc11cf3b1443ccb55a8162d21229d8"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "6ef31ae8ea7162e05bd81c07a36f1517"
server_key_iv: "d60e2adeebf47d1ff96d13b09abeadfc"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.812983 3383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "fffc11cf3b1443ccb55a8162d21229d8"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "6ef31ae8ea7162e05bd81c07a36f1517"
server_key_iv: "d60e2adeebf47d1ff96d13b09abeadfc"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.814242 3383 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:43:44.814934 3413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:44.815083 3383 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:43:44.815163 3383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "fffc11cf3b1443ccb55a8162d21229d8"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "6ef31ae8ea7162e05bd81c07a36f1517"
server_key_iv: "d60e2adeebf47d1ff96d13b09abeadfc"
server_key_version: "encryptionkey@0"
I20260808 17:43:44.815228 3383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:43:44.828867 3383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:43:44.830943 3383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:43:44.831075 3383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:43:44.831272 3383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:43:44.831542 3383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:43:44.831574 3383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:44.831601 3383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:43:44.831624 3383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:43:44.836926 3383 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:46367
I20260808 17:43:44.836982 3591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:46367 every 8 connection(s)
I20260808 17:43:44.837261 3383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:43:44 dist-test-slave-bqcl krb5kdc[2801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211024, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:43:44.843637 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 3383
I20260808 17:43:44.843751 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:43:44.843943 9967 external_mini_cluster.cc:1428] Setting key 44d930c2c05b48ca71f2362d89453f3d
I20260808 17:43:44.845873 2960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.837968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:34671 (local address 127.9.187.254:46251)
0808 17:43:44.838034 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:44.838036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:44.838179 (+ 143us) server_negotiation.cc:407] Connection header received
0808 17:43:44.838645 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:44.838646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:44.838656 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:44.838724 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:44.839661 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.840178 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.841142 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.841324 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.841371 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.843310 (+ 1939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:44.843311 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:44.843312 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:44.843318 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:44.844758 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:44.845119 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:44.845120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:44.845120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:44.845171 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:44.845346 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:44.845347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:44.845347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:44.845439 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:44.845483 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:44.845732 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 17:43:44.845808 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 17:43:44.845918 3597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.837903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:34671)
0808 17:43:44.838048 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:44.838088 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:44.838565 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:44.838774 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:44.838777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:44.839311 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:43:44.839491 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.839495 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.840273 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.840274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.841064 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.841067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.841379 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.841380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.841469 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.841918 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:43:44.841927 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:43:44.843228 (+ 1301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:43:44.844831 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:44.844837 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:44.844840 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:44.845064 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:44.845211 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:43:44.845211 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:43:44.845211 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:43:44.845308 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:43:44.845481 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:43:44.845484 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:43:44.845585 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 17:43:44.845660 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 17:43:44.845767 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260808 17:43:44.846383 3593 heartbeater.cc:347] Connected to a master server at 127.9.187.254:46251
I20260808 17:43:44.846477 3593 heartbeater.cc:464] Registering TS with master...
I20260808 17:43:44.846650 3593 heartbeater.cc:511] Master 127.9.187.254:46251 requested a full tablet report, sending...
I20260808 17:43:44.846987 2865 ts_manager.cc:194] Registered new tserver with Master: fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367)
I20260808 17:43:44.847337 2865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:34671
I20260808 17:43:44.855568 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:43:44.862303 2960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.856817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39116 (local address 127.9.187.254:46251)
0808 17:43:44.856872 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:44.856874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:44.856951 (+ 77us) server_negotiation.cc:407] Connection header received
0808 17:43:44.857011 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:44.857012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:44.857021 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:44.857066 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:43:44.857594 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.858038 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.858757 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.858932 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.858984 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.860068 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:43:44.860070 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:43:44.860070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:43:44.860078 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:43:44.861205 (+ 1127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:44.861508 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:44.861509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:44.861509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:44.861570 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:43:44.861750 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:43:44.861751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:43:44.861751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:43:44.861889 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:43:44.861973 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:44.862113 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 17:43:44.862201 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:43:44.863793 2865 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:43:44.865275 2865 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:43:44.871095 3614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.867202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:36771 (local address 127.0.0.1:42636)
0808 17:43:44.867482 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:44.867492 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:44.867581 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:44.868025 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:44.868026 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:44.868028 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:44.868075 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.868076 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.869254 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.869255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.870015 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.870018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.870803 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.870804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.870886 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.870900 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:43:44.870962 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 17:43:44.871014 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":3,"thread_start_us":50,"threads_started":1}
I20260808 17:43:44.871096 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.867370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42636 (local address 127.9.187.194:36771)
0808 17:43:44.867849 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:44.867854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:44.867864 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:43:44.867899 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:44.867901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:44.867916 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:44.868028 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:44.868126 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.869174 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.870106 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.870727 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.870788 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.870845 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:44.870983 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 17:43:44.871018 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":89,"threads_started":1}
I20260808 17:43:44.871490 3611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.867195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:46367 (local address 127.0.0.1:55854)
0808 17:43:44.867312 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:44.867350 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:44.867408 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:44.867686 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:44.867689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:44.867691 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:44.867744 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.867746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.869187 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.869187 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.870347 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.870351 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.871256 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.871257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.871332 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.871336 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:43:44.871365 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 17:43:44.871406 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":68,"threads_started":1}
I20260808 17:43:44.871490 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.867388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:44483 (local address 127.0.0.1:40580)
0808 17:43:44.867530 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:44.867538 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:44.867581 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:44.868134 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:44.868134 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:44.868136 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:44.868169 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.868170 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.868981 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.868982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.870350 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:44.870352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.871305 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.871306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:44.871353 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.871357 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:43:44.871398 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 17:43:44.871425 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":56,"thread_start_us":55,"threads_started":1}
I20260808 17:43:44.871727 3617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.867631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40580 (local address 127.9.187.193:44483)
0808 17:43:44.867830 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:44.867834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:44.867844 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:43:44.867881 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:44.867883 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:44.867961 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:44.868035 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:44.868217 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.868894 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.870446 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.871156 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.871221 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.871277 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:44.871531 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 17:43:44.871646 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":95,"threads_started":1}
I20260808 17:43:44.871815 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:44.867276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55854 (local address 127.9.187.195:46367)
0808 17:43:44.867538 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:44.867543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:44.867552 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:43:44.867586 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:44.867588 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:44.867603 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:44.867681 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:44.867818 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.869083 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.870446 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:44.871152 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:44.871623 (+ 471us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:44.871687 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:44.871710 (+ 23us) server_negotiation.cc:299] Negotiation successful
0808 17:43:44.871747 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":83,"threads_started":1}
I20260808 17:43:44.871881 3273 tablet_service.cc:1467] Processing CreateTablet for tablet 9e60d60212bd48caaba74966db5cc147 (DEFAULT_TABLE table=test-table [id=1d173b98d40741f5a3f5e12dc488f844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:44.872225 3273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e60d60212bd48caaba74966db5cc147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:44.872340 3485 tablet_service.cc:1467] Processing CreateTablet for tablet 9e60d60212bd48caaba74966db5cc147 (DEFAULT_TABLE table=test-table [id=1d173b98d40741f5a3f5e12dc488f844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:44.872622 3485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e60d60212bd48caaba74966db5cc147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:44.874886 3619 tablet_bootstrap.cc:492] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: Bootstrap starting.
I20260808 17:43:44.875097 3060 tablet_service.cc:1467] Processing CreateTablet for tablet 9e60d60212bd48caaba74966db5cc147 (DEFAULT_TABLE table=test-table [id=1d173b98d40741f5a3f5e12dc488f844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:43:44.875257 3620 tablet_bootstrap.cc:492] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8: Bootstrap starting.
I20260808 17:43:44.875433 3060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e60d60212bd48caaba74966db5cc147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:43:44.875571 3619 tablet_bootstrap.cc:654] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:44.875878 3620 tablet_bootstrap.cc:654] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:44.876048 3619 log.cc:824] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:44.876392 3620 log.cc:824] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:44.876708 3619 tablet_bootstrap.cc:492] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: No bootstrap required, opened a new log
I20260808 17:43:44.876782 3619 ts_tablet_manager.cc:1397] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:43:44.877157 3620 tablet_bootstrap.cc:492] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8: No bootstrap required, opened a new log
I20260808 17:43:44.877231 3620 ts_tablet_manager.cc:1397] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:43:44.878146 3619 raft_consensus.cc:348] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:43:44.878301 3619 raft_consensus.cc:374] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:44.878340 3619 raft_consensus.cc:729] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c417502da8164ae18e15d8d3aa043cc3, State: Initialized, Role: FOLLOWER
I20260808 17:43:44.878455 3619 consensus_queue.cc:260] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:43:44.878631 3623 tablet_bootstrap.cc:492] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Bootstrap starting.
I20260808 17:43:44.878744 3619 ts_tablet_manager.cc:1428] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:43:44.878856 3375 heartbeater.cc:503] Master 127.9.187.254:46251 was elected leader, sending a full tablet report...
I20260808 17:43:44.879103 3620 raft_consensus.cc:348] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:43:44.879268 3620 raft_consensus.cc:374] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:44.879294 3620 raft_consensus.cc:729] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fffc11cf3b1443ccb55a8162d21229d8, State: Initialized, Role: FOLLOWER
I20260808 17:43:44.879376 3620 consensus_queue.cc:260] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:43:44.879536 3623 tablet_bootstrap.cc:654] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Neither blocks nor log segments found. Creating new log.
I20260808 17:43:44.879628 3620 ts_tablet_manager.cc:1428] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:43:44.879768 3593 heartbeater.cc:503] Master 127.9.187.254:46251 was elected leader, sending a full tablet report...
I20260808 17:43:44.880095 3623 log.cc:824] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:43:44.880817 3623 tablet_bootstrap.cc:492] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: No bootstrap required, opened a new log
I20260808 17:43:44.880875 3623 ts_tablet_manager.cc:1397] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:43:44.882341 3623 raft_consensus.cc:348] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:43:44.882467 3623 raft_consensus.cc:374] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:43:44.882498 3623 raft_consensus.cc:729] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04d4c28162742ac9f424be01476586f, State: Initialized, Role: FOLLOWER
I20260808 17:43:44.882602 3623 consensus_queue.cc:260] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:43:44.882817 3623 ts_tablet_manager.cc:1428] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:43:44.882864 3166 heartbeater.cc:503] Master 127.9.187.254:46251 was elected leader, sending a full tablet report...
W20260808 17:43:44.933220 3378 tablet.cc:2369] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:43:45.031864 3167 tablet.cc:2369] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:43:45.036173 3625 raft_consensus.cc:482] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:43:45.036301 3625 raft_consensus.cc:504] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:43:45.036620 3625 leader_election.cc:288] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771), b04d4c28162742ac9f424be01476586f (127.9.187.193:44483)
I20260808 17:43:45.040375 3617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:45.037003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:35205 (local address 127.9.187.193:44483)
0808 17:43:45.037050 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:45.037052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:45.037163 (+ 111us) server_negotiation.cc:407] Connection header received
0808 17:43:45.037194 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:45.037195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:45.037205 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:45.037248 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:45.037374 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:45.038053 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:45.039451 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:45.040012 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:45.040084 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:45.040093 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:45.040262 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 17:43:45.040304 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:43:45.040405 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:45.036913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:46583 (local address 127.9.187.194:36771)
0808 17:43:45.036991 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:45.036993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:45.037004 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:43:45.037035 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:45.037036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:45.037047 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:45.037098 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:43:45.037285 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:45.038022 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:45.039451 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:45.040007 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:45.040084 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:45.040093 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:45.040306 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 17:43:45.040347 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 17:43:45.040395 3597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:45.036810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:36771 (local address 127.9.187.195:46583)
0808 17:43:45.036878 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:45.036891 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:45.036957 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:45.037133 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:45.037133 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:45.037136 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:45.037212 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:45.037214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:45.038106 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:45.038106 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:45.039366 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:45.039369 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:45.040088 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:45.040089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:45.040192 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:45.040194 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:43:45.040250 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:43:45.040319 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":6}
I20260808 17:43:45.040565 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:45.036928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:44483 (local address 127.9.187.195:35205)
0808 17:43:45.037090 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:45.037099 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:43:45.037147 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:43:45.037265 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:43:45.037265 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:43:45.037267 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:43:45.037320 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:45.037321 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:45.038114 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:45.038115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:45.039366 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:43:45.039369 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:43:45.040088 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:43:45.040089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:43:45.040189 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:45.040194 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:43:45.040249 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 17:43:45.040386 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":130,"thread_start_us":99,"threads_started":1}
I20260808 17:43:45.040810 3311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e60d60212bd48caaba74966db5cc147" candidate_uuid: "fffc11cf3b1443ccb55a8162d21229d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c417502da8164ae18e15d8d3aa043cc3" is_pre_election: true
I20260808 17:43:45.040946 3311 raft_consensus.cc:2454] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fffc11cf3b1443ccb55a8162d21229d8 in term 0.
I20260808 17:43:45.040907 3092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e60d60212bd48caaba74966db5cc147" candidate_uuid: "fffc11cf3b1443ccb55a8162d21229d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04d4c28162742ac9f424be01476586f" is_pre_election: true
I20260808 17:43:45.041055 3092 raft_consensus.cc:2454] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fffc11cf3b1443ccb55a8162d21229d8 in term 0.
I20260808 17:43:45.041186 3419 leader_election.cc:302] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c417502da8164ae18e15d8d3aa043cc3, fffc11cf3b1443ccb55a8162d21229d8; no voters:
I20260808 17:43:45.041297 3625 raft_consensus.cc:2781] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:43:45.041358 3625 raft_consensus.cc:482] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:43:45.041373 3625 raft_consensus.cc:3037] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:45.042047 3625 raft_consensus.cc:504] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:43:45.042207 3625 leader_election.cc:288] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [CANDIDATE]: Term 1 election: Requested vote from peers c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771), b04d4c28162742ac9f424be01476586f (127.9.187.193:44483)
I20260808 17:43:45.042369 3311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e60d60212bd48caaba74966db5cc147" candidate_uuid: "fffc11cf3b1443ccb55a8162d21229d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c417502da8164ae18e15d8d3aa043cc3"
I20260808 17:43:45.042419 3092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e60d60212bd48caaba74966db5cc147" candidate_uuid: "fffc11cf3b1443ccb55a8162d21229d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04d4c28162742ac9f424be01476586f"
I20260808 17:43:45.042454 3311 raft_consensus.cc:3037] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:45.042481 3092 raft_consensus.cc:3037] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:43:45.043196 3092 raft_consensus.cc:2454] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fffc11cf3b1443ccb55a8162d21229d8 in term 1.
I20260808 17:43:45.043207 3311 raft_consensus.cc:2454] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fffc11cf3b1443ccb55a8162d21229d8 in term 1.
I20260808 17:43:45.043354 3419 leader_election.cc:302] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04d4c28162742ac9f424be01476586f, fffc11cf3b1443ccb55a8162d21229d8; no voters:
I20260808 17:43:45.043437 3625 raft_consensus.cc:2781] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:43:45.043592 3625 raft_consensus.cc:686] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 1 LEADER]: Becoming Leader. State: Replica: fffc11cf3b1443ccb55a8162d21229d8, State: Running, Role: LEADER
I20260808 17:43:45.043674 3625 consensus_queue.cc:237] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:43:45.044574 2865 catalog_manager.cc:5495] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195). New cstate: current_term: 1 leader_uuid: "fffc11cf3b1443ccb55a8162d21229d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } health_report { overall_health: UNKNOWN } } }
I20260808 17:43:45.055840 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:45.053743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55868 (local address 127.9.187.195:46367)
0808 17:43:45.053786 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:43:45.053788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:43:45.053795 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:43:45.053839 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:43:45.053840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:43:45.053855 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:43:45.053905 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:43:45.054002 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:45.054514 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:45.055209 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:43:45.055386 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:43:45.055430 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:43:45.055523 (+ 93us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:43:45.055641 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:43:45.055700 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:43:45.055731 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 17:43:45.055746 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:43:45.057487 3311 raft_consensus.cc:1261] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3 [term 1 FOLLOWER]: Refusing update from remote peer fffc11cf3b1443ccb55a8162d21229d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:43:45.057487 3092 raft_consensus.cc:1261] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Refusing update from remote peer fffc11cf3b1443ccb55a8162d21229d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:43:45.057819 3625 consensus_queue.cc:1035] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:43:45.057955 3629 consensus_queue.cc:1035] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:43:45.060206 3634 mvcc.cc:205] Tried to move back new op lower bound from 7316320358633103360 to 7316320358579523584. Current Snapshot: MvccSnapshot[applied={T|T < 7316320358633103360}]
I20260808 17:43:45.060485 3635 mvcc.cc:205] Tried to move back new op lower bound from 7316320358633103360 to 7316320358579523584. Current Snapshot: MvccSnapshot[applied={T|T < 7316320358633103360}]
I20260808 17:43:45.062747 2864 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:43:45.062848 2864 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:43:45.063601 2864 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Sending DeleteTablet for 3 replicas of tablet 9e60d60212bd48caaba74966db5cc147
I20260808 17:43:45.063905 3485 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e60d60212bd48caaba74966db5cc147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:45 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:55854
I20260808 17:43:45.063995 3060 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e60d60212bd48caaba74966db5cc147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:45 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:40580
I20260808 17:43:45.063982 3273 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e60d60212bd48caaba74966db5cc147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:45 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:42636
I20260808 17:43:45.064108 3646 tablet_replica.cc:330] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8: stopping tablet replica
I20260808 17:43:45.064204 3646 raft_consensus.cc:2229] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:43:45.064200 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 2964
I20260808 17:43:45.064294 3646 raft_consensus.cc:2258] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:43:45.074460 3646 ts_tablet_manager.cc:1905] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:43:45.076433 3646 ts_tablet_manager.cc:1918] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:43:45.076512 3646 log.cc:1196] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/9e60d60212bd48caaba74966db5cc147
I20260808 17:43:45.076762 3646 ts_tablet_manager.cc:1939] T 9e60d60212bd48caaba74966db5cc147 P fffc11cf3b1443ccb55a8162d21229d8: Deleting consensus metadata
I20260808 17:43:45.077224 2845 catalog_manager.cc:4841] TS fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367): tablet 9e60d60212bd48caaba74966db5cc147 (table test-table [id=1d173b98d40741f5a3f5e12dc488f844]) successfully deleted
I20260808 17:43:45.081302 3648 tablet_replica.cc:330] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: stopping tablet replica
I20260808 17:43:45.081439 3648 raft_consensus.cc:2229] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:43:45.081557 3648 raft_consensus.cc:2258] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:43:45.081990 3648 ts_tablet_manager.cc:1905] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:43:45.083271 3648 ts_tablet_manager.cc:1918] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:43:45.083341 3648 log.cc:1196] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/9e60d60212bd48caaba74966db5cc147
I20260808 17:43:45.083580 3648 ts_tablet_manager.cc:1939] T 9e60d60212bd48caaba74966db5cc147 P c417502da8164ae18e15d8d3aa043cc3: Deleting consensus metadata
I20260808 17:43:45.083971 2848 catalog_manager.cc:4841] TS c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771): tablet 9e60d60212bd48caaba74966db5cc147 (table test-table [id=1d173b98d40741f5a3f5e12dc488f844]) successfully deleted
W20260808 17:43:45.086484 2848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:44483 (error 108)
I20260808 17:43:45.086745 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 3171
I20260808 17:43:45.087005 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:43:45.086861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:44483 (local address 127.0.0.1:40586)
0808 17:43:45.086917 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 17:43:45.086971 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:44483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 17:43:45.103695 2848 catalog_manager.cc:4584] TS b04d4c28162742ac9f424be01476586f (127.9.187.193:44483): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9e60d60212bd48caaba74966db5cc147: Network error: Client connection negotiation failed: client connection to 127.9.187.193:44483: connect: Connection refused (error 111)
I20260808 17:43:45.109570 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 3383
I20260808 17:43:45.118822 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 2821
I20260808 17:44:05.126876 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46251
--webserver_interface=127.9.187.254
--webserver_port=45613
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:46251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:05.209818 3651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:05.210027 3651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:05.210047 3651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:05.211174 3651 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 17:44:05.211215 3651 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 17:44:05.211227 3651 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 17:44:05.211237 3651 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:05.211248 3651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:05.211263 3651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:05.211277 3651 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:05.211293 3651 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:05.212747 3651 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:46251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=45613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:05.212942 3651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:05.213116 3651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:05.222302 3662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:05.222369 3651 server_base.cc:1034] running on GCE node
W20260808 17:44:05.222337 3661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:05.222312 3664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:05.222752 3651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:05.223040 3651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:05.224175 3651 hybrid_clock.cc:648] HybridClock initialized: now 1786211045224164 us; error 29 us; skew 500 ppm
Aug 08 17:44:05 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211045, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:05.230428 3651 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:44:05.230851 3651 webserver.cc:460] Webserver started at http://127.9.187.254:45613/ using document root <none> and password file <none>
I20260808 17:44:05.231081 3651 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:05.231141 3651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:05.232465 3651 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:44:05.233069 3673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:05.233237 3651 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:44:05.233330 3651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "f5058378d4d34b4b933a31e33bc1b002"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "a7b8edce55f4ab1b81fb99165c5cdcaa"
server_key_iv: "b5425115730704bdce4d8c03a60db5e8"
server_key_version: "encryptionkey@0"
I20260808 17:44:05.233721 3651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:05.263414 3651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:05.265293 3651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:05.265436 3651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:05.269364 3651 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:46251
I20260808 17:44:05.269405 3765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:46251 every 8 connection(s)
I20260808 17:44:05.269783 3651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:05.271260 3768 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:44:05.271922 3768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Bootstrap starting.
I20260808 17:44:05.273388 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 3651
I20260808 17:44:05.273716 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:44483
--local_ip_for_outbound_sockets=127.9.187.193
--tserver_master_addrs=127.9.187.254:46251
--webserver_port=39213
--webserver_interface=127.9.187.193
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:44:05.281041 3768 log.cc:824] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:05.283038 3768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:44:05.283315 3768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Bootstrap complete.
I20260808 17:44:05.285452 3768 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:44:05.285678 3768 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5058378d4d34b4b933a31e33bc1b002, State: Initialized, Role: FOLLOWER
I20260808 17:44:05.285845 3768 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:44:05.285904 3768 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:05.285948 3768 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:05.285997 3768 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:44:05.287063 3768 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:44:05.287156 3768 leader_election.cc:302] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5058378d4d34b4b933a31e33bc1b002; no voters:
I20260808 17:44:05.287333 3768 leader_election.cc:288] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 17:44:05.287384 3773 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 17:44:05.287575 3773 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 2 LEADER]: Becoming Leader. State: Replica: f5058378d4d34b4b933a31e33bc1b002, State: Running, Role: LEADER
I20260808 17:44:05.287606 3768 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:05.287738 3773 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:44:05.288070 3776 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f5058378d4d34b4b933a31e33bc1b002" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } } }
I20260808 17:44:05.288151 3776 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:05.288389 3777 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5058378d4d34b4b933a31e33bc1b002. Latest consensus state: current_term: 2 leader_uuid: "f5058378d4d34b4b933a31e33bc1b002" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } } }
I20260808 17:44:05.288488 3777 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:05.289381 3796 catalog_manager.cc:1259] Loaded cluster ID: 3c5cefc3c0be4e1181e967c972d3f3c9
I20260808 17:44:05.289420 3796 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: loading cluster ID for follower catalog manager: success
I20260808 17:44:05.290251 3796 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: acquiring CA information for follower catalog manager: success
I20260808 17:44:05.290592 3796 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:44:05.290649 3783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:05.290975 3783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:05.291043 3783 catalog_manager.cc:1259] Loaded cluster ID: 3c5cefc3c0be4e1181e967c972d3f3c9
I20260808 17:44:05.291100 3783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:05.291281 3783 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:05.291358 3783 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Loaded TSK: 0
I20260808 17:44:05.302780 3783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Generated new TSK 1
I20260808 17:44:05.302876 3783 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:44:05.374513 3771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:05.374725 3771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:05.374747 3771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:05.376014 3771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:05.376068 3771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:05.376096 3771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:44:05.377873 3771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:44483
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=39213
--tserver_master_addrs=127.9.187.254:46251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:05.378105 3771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:05.378403 3771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:05.384235 3810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:05.384260 3813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:05.384261 3811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:05.384537 3771 server_base.cc:1034] running on GCE node
I20260808 17:44:05.384766 3771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:05.385057 3771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:05.386196 3771 hybrid_clock.cc:648] HybridClock initialized: now 1786211045386173 us; error 34 us; skew 500 ppm
Aug 08 17:44:05 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211045, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:05.389343 3771 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:44:05.389791 3771 webserver.cc:460] Webserver started at http://127.9.187.193:39213/ using document root <none> and password file <none>
I20260808 17:44:05.390003 3771 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:05.390069 3771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:05.391451 3771 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:44:05.392127 3824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:05.392283 3771 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:44:05.392366 3771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "b04d4c28162742ac9f424be01476586f"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "821b23597478ee4f78d5716867c7771d"
server_key_iv: "5ea0567c4397b2a228aace95405c303e"
server_key_version: "encryptionkey@0"
I20260808 17:44:05.392678 3771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:05.417340 3771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:05.419787 3771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:05.419924 3771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:05.420153 3771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:05.420624 3833 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 17:44:05.422067 3771 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 17:44:05.422144 3771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 17:44:05.422180 3771 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 17:44:05.423029 3771 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 17:44:05.423081 3771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 17:44:05.423143 3833 tablet_bootstrap.cc:492] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Bootstrap starting.
I20260808 17:44:05.430151 3771 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:44483
I20260808 17:44:05.430331 3997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:44483 every 8 connection(s)
I20260808 17:44:05.430598 3771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:44:05.433068 3833 log.cc:824] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:05.435132 3833 tablet_bootstrap.cc:492] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:44:05.435423 3833 tablet_bootstrap.cc:492] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Bootstrap complete.
I20260808 17:44:05.436465 3833 ts_tablet_manager.cc:1397] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.010s
I20260808 17:44:05.437546 3833 raft_consensus.cc:348] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:05.437839 3833 raft_consensus.cc:729] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04d4c28162742ac9f424be01476586f, State: Initialized, Role: FOLLOWER
I20260808 17:44:05.437973 3833 consensus_queue.cc:260] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:05.438239 3833 ts_tablet_manager.cc:1428] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Time spent starting tablet: real 0.002s user 0.002s sys 0.002s
Aug 08 17:44:05 dist-test-slave-bqcl krb5kdc[2801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211045, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:05.440130 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 3771
I20260808 17:44:05.440418 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:36771
--local_ip_for_outbound_sockets=127.9.187.194
--tserver_master_addrs=127.9.187.254:46251
--webserver_port=42281
--webserver_interface=127.9.187.194
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:44:05.442795 4000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.431341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:50345 (local address 127.9.187.254:46251)
0808 17:44:05.431517 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.431526 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.431801 (+ 275us) server_negotiation.cc:407] Connection header received
0808 17:44:05.432472 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.432482 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.432556 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.432712 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:05.433536 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.434917 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.436391 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.436968 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.437089 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.439334 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:05.439337 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:05.439338 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:05.439347 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:05.441143 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.441527 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.441530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.441530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.441643 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.441847 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.441848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.441848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.442154 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:05.442232 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:05.442541 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 17:44:05.442643 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
I20260808 17:44:05.442845 4003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.431293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:50345)
0808 17:44:05.431617 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:05.431661 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:05.432232 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:05.432740 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:05.432743 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:05.433075 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:05.433324 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.433330 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.435041 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.435042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.436314 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.436317 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.437080 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.437081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.437243 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.437743 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:05.437752 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:05.439235 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:05.441226 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:05.441232 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:05.441234 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:05.441450 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:05.441702 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:05.441702 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:05.441703 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:05.441795 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:05.442229 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:05.442236 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:05.442393 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 17:44:05.442499 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 17:44:05.442660 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":132,"threads_started":1}
I20260808 17:44:05.443769 3998 heartbeater.cc:347] Connected to a master server at 127.9.187.254:46251
I20260808 17:44:05.443884 3998 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:05.444062 3998 heartbeater.cc:511] Master 127.9.187.254:46251 requested a full tablet report, sending...
I20260808 17:44:05.444824 3702 ts_manager.cc:194] Registered new tserver with Master: b04d4c28162742ac9f424be01476586f (127.9.187.193:44483)
I20260808 17:44:05.445858 3702 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:50345
I20260808 17:44:05.446879 3998 heartbeater.cc:503] Master 127.9.187.254:46251 was elected leader, sending a full tablet report...
Aug 08 17:44:05 dist-test-slave-bqcl krb5kdc[2801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211045, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.193@KRBTEST.COM
I20260808 17:44:05.453256 4010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.445480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47482 (local address 127.9.187.193:44483)
0808 17:44:05.445633 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.445637 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.446316 (+ 679us) server_negotiation.cc:407] Connection header received
0808 17:44:05.446419 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.446422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.446435 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.446496 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:05.446924 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.447660 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.448405 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.448700 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.448757 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.450873 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:05.450880 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:05.450880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:05.450886 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:05.452211 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.452616 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.452618 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.452618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.452668 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.452826 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.452826 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.452827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.452930 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:05.452984 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:05.453135 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 17:44:05.453195 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
I20260808 17:44:05.453400 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.445412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:44483 (local address 127.0.0.1:47482)
0808 17:44:05.446226 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:05.446262 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:05.446338 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:05.446502 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:05.446507 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:05.446813 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:05.446857 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.446859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.447730 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.447731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.448330 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.448332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.448765 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.448766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.448843 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.449275 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:05.449279 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:05.450795 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:05.452287 (+ 1492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:05.452294 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:05.452296 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:05.452543 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:05.452716 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:05.452717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:05.452717 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:05.452778 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:05.452978 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:05.452983 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:05.453031 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 17:44:05.453112 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 17:44:05.453250 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":89,"threads_started":1}
I20260808 17:44:05.453781 3894 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e60d60212bd48caaba74966db5cc147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:43:45 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:47482
I20260808 17:44:05.454239 4012 tablet_replica.cc:330] stopping tablet replica
I20260808 17:44:05.454334 4012 raft_consensus.cc:2229] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:05.454401 4012 raft_consensus.cc:2258] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:05.454674 4012 ts_tablet_manager.cc:1905] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:05.456493 4012 ts_tablet_manager.cc:1918] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:05.456553 4012 log.cc:1196] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal/wals/9e60d60212bd48caaba74966db5cc147
I20260808 17:44:05.456806 4012 ts_tablet_manager.cc:1939] T 9e60d60212bd48caaba74966db5cc147 P b04d4c28162742ac9f424be01476586f: Deleting consensus metadata
I20260808 17:44:05.457242 3680 catalog_manager.cc:4841] TS b04d4c28162742ac9f424be01476586f (127.9.187.193:44483): tablet 9e60d60212bd48caaba74966db5cc147 (table test-table [id=1d173b98d40741f5a3f5e12dc488f844]) successfully deleted
W20260808 17:44:05.524012 4007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:05.524216 4007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:05.524246 4007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:05.525352 4007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:05.525390 4007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:05.525424 4007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:44:05.526883 4007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:36771
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=42281
--tserver_master_addrs=127.9.187.254:46251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:05.527107 4007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:05.527311 4007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:05.531976 4023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:05.531947 4019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:05.531960 4018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:05.532246 4007 server_base.cc:1034] running on GCE node
I20260808 17:44:05.532446 4007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:05.532698 4007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:05.533847 4007 hybrid_clock.cc:648] HybridClock initialized: now 1786211045533834 us; error 27 us; skew 500 ppm
Aug 08 17:44:05 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211045, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:05.536226 4007 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:44:05.536696 4007 webserver.cc:460] Webserver started at http://127.9.187.194:42281/ using document root <none> and password file <none>
I20260808 17:44:05.536897 4007 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:05.536960 4007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:05.538404 4007 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:44:05.538960 4032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:05.539100 4007 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:05.539184 4007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "c417502da8164ae18e15d8d3aa043cc3"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "1f7bd115e7eb480ece093cdf2aeba732"
server_key_iv: "c17a9e2e23244a093b3a55fe2944dd29"
server_key_version: "encryptionkey@0"
I20260808 17:44:05.539532 4007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:05.550550 4007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:05.552192 4007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:05.552325 4007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:05.552533 4007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:05.552816 4007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:05.552850 4007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:05.552877 4007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:05.552896 4007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:05.558415 4007 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:36771
I20260808 17:44:05.558454 4209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:36771 every 8 connection(s)
I20260808 17:44:05.558789 4007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:44:05 dist-test-slave-bqcl krb5kdc[2801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211045, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:05.566838 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 4007
I20260808 17:44:05.567137 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:46367
--local_ip_for_outbound_sockets=127.9.187.195
--tserver_master_addrs=127.9.187.254:46251
--webserver_port=45209
--webserver_interface=127.9.187.195
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:44:05.567369 4000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.559457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:58603 (local address 127.9.187.254:46251)
0808 17:44:05.559535 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.559537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.559677 (+ 140us) server_negotiation.cc:407] Connection header received
0808 17:44:05.560138 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.560139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.560152 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.560188 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:05.561087 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.561579 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.562590 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.562788 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.562832 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.564787 (+ 1955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:05.564789 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:05.564789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:05.564796 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:05.566056 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.566431 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.566431 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.566432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.566477 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.566741 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.566741 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.566741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.566835 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:05.566879 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:05.567186 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 17:44:05.567282 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 17:44:05.567541 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.559424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:58603)
0808 17:44:05.559565 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:05.559601 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:05.560050 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:05.560249 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:05.560252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:05.560818 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:05.561016 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.561021 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.561647 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.561648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.562524 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.562526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.562841 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.562842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.562935 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.563342 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:05.563351 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:05.564695 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:05.566153 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:05.566159 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:05.566161 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:05.566372 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:05.566545 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:05.566546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:05.566546 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:05.566671 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:05.566886 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:05.566893 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:05.567054 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 17:44:05.567168 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 17:44:05.567331 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":76,"threads_started":1}
I20260808 17:44:05.568011 4210 heartbeater.cc:347] Connected to a master server at 127.9.187.254:46251
I20260808 17:44:05.568101 4210 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:05.568272 4210 heartbeater.cc:511] Master 127.9.187.254:46251 requested a full tablet report, sending...
I20260808 17:44:05.568646 3702 ts_manager.cc:194] Registered new tserver with Master: c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771)
I20260808 17:44:05.569015 3702 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:58603
W20260808 17:44:05.647250 4217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:05.647447 4217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:05.647468 4217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:05.648535 4217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:05.648567 4217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:05.648591 4217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:44:05.649941 4217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:46367
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=45209
--tserver_master_addrs=127.9.187.254:46251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:05.650254 4217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:05.650472 4217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:05.655254 4233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:05.655330 4217 server_base.cc:1034] running on GCE node
W20260808 17:44:05.655258 4228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:05.655254 4225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:05.655758 4217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:05.656005 4217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:05.657152 4217 hybrid_clock.cc:648] HybridClock initialized: now 1786211045657139 us; error 44 us; skew 500 ppm
Aug 08 17:44:05 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211045, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:05.659595 4217 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:44:05.660006 4217 webserver.cc:460] Webserver started at http://127.9.187.195:45209/ using document root <none> and password file <none>
I20260808 17:44:05.660207 4217 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:05.660261 4217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:05.661530 4217 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:44:05.662034 4245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:05.662191 4217 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:05.662276 4217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "fffc11cf3b1443ccb55a8162d21229d8"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "6ef31ae8ea7162e05bd81c07a36f1517"
server_key_iv: "d60e2adeebf47d1ff96d13b09abeadfc"
server_key_version: "encryptionkey@0"
I20260808 17:44:05.662575 4217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:05.678177 4217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:05.680246 4217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:05.680356 4217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:05.680524 4217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:05.680814 4217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:05.680847 4217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:05.680868 4217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:05.680891 4217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:05.686241 4217 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:46367
I20260808 17:44:05.686300 4430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:46367 every 8 connection(s)
I20260808 17:44:05.686622 4217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:44:05 dist-test-slave-bqcl krb5kdc[2801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211045, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:05.692709 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 4217
I20260808 17:44:05.695789 4000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.687319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:44511 (local address 127.9.187.254:46251)
0808 17:44:05.687365 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.687367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.687555 (+ 188us) server_negotiation.cc:407] Connection header received
0808 17:44:05.688094 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.688095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.688109 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.688160 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:05.689129 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.689613 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.690648 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.690858 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.690915 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.692935 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:05.692937 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:05.692938 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:05.692946 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:05.694431 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.694807 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.694808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.694809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.694881 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.695100 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.695102 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.695102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.695218 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:05.695273 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:05.695559 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 17:44:05.695646 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:44:05.695884 4434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.687304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:44511)
0808 17:44:05.687441 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:05.687477 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:05.688001 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:05.688236 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:05.688240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:05.688852 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:05.689037 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.689043 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.689692 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.689693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.690567 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.690570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.690926 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.690928 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.691050 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.691470 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:05.691479 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:05.692854 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:05.694499 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:05.694505 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:05.694507 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:05.694744 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:05.694940 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:05.694941 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:05.694941 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:05.695045 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:05.695273 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:05.695279 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:05.695430 (+ 151us) client_negotiation.cc:769] Sending connection context
0808 17:44:05.695527 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 17:44:05.695678 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":69,"threads_started":1}
I20260808 17:44:05.696455 4432 heartbeater.cc:347] Connected to a master server at 127.9.187.254:46251
I20260808 17:44:05.696571 4432 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:05.696775 4432 heartbeater.cc:511] Master 127.9.187.254:46251 requested a full tablet report, sending...
I20260808 17:44:05.697152 3702 ts_manager.cc:194] Registered new tserver with Master: fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367)
I20260808 17:44:05.697495 3702 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:44511
I20260808 17:44:05.699302 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.693090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49006 (local address 127.9.187.254:46251)
0808 17:44:05.693209 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.693210 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.693310 (+ 100us) server_negotiation.cc:407] Connection header received
0808 17:44:05.693375 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.693376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.693387 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.693465 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:05.694174 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.694656 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.695423 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.695663 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.695719 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.697039 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:05.697040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:05.697041 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:05.697047 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:05.698460 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.698775 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.698776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.698776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.698820 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.698941 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.698942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.698942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.699023 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:05.699129 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:05.699182 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 17:44:05.699243 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":53,"threads_started":1}
I20260808 17:44:05.699945 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:44:05.702291 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.700254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49020 (local address 127.9.187.254:46251)
0808 17:44:05.700299 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.700301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.700385 (+ 84us) server_negotiation.cc:407] Connection header received
0808 17:44:05.700435 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.700436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.700462 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.700515 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:44:05.700581 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.701008 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.701693 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.701881 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.701934 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.702036 (+ 102us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:44:05.702087 (+ 51us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 17:44:05.702250 (+ 163us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49020: token expired
Metrics: {"server-negotiator.queue_time_us":27}
W20260808 17:44:05.702334 4436 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49020: token expired
W20260808 17:44:05.702550 3604 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.187.254:46251)
I20260808 17:44:05.707455 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.702763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49022 (local address 127.9.187.254:46251)
0808 17:44:05.702800 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.702802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.702810 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:05.702868 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.702868 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.702875 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.702904 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:05.703285 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.703698 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.704354 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.704513 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.704550 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.705480 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:05.705481 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:05.705482 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:05.705487 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:05.706709 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.706979 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.706980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.706980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.707019 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:05.707131 (+ 112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:05.707132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:05.707132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:05.707219 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:05.707280 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:05.707346 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 17:44:05.707397 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:44:05.708511 3702 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:44:05.709990 3702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:44:05.712090 3894 tablet_service.cc:1467] Processing CreateTablet for tablet 351c70286e8246dc8607787952a5edcd (DEFAULT_TABLE table=test-table [id=dc62df3c8f8a42eaa4147c95d0af7025]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:05.712299 3894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 351c70286e8246dc8607787952a5edcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:05.713598 3833 tablet_bootstrap.cc:492] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: Bootstrap starting.
I20260808 17:44:05.713891 3833 tablet_bootstrap.cc:654] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:05.714785 3833 tablet_bootstrap.cc:492] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: No bootstrap required, opened a new log
I20260808 17:44:05.714859 3833 ts_tablet_manager.cc:1397] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:44:05.715010 3833 raft_consensus.cc:348] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:05.715091 3833 raft_consensus.cc:374] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:05.715142 3833 raft_consensus.cc:729] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04d4c28162742ac9f424be01476586f, State: Initialized, Role: FOLLOWER
I20260808 17:44:05.715184 3833 consensus_queue.cc:260] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:05.715276 3833 ts_tablet_manager.cc:1428] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:05.715778 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.711668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:46367 (local address 127.0.0.1:51602)
0808 17:44:05.711713 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:05.711723 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:05.711757 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:05.712198 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:05.712199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:05.712201 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:05.712242 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.712243 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.713396 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.713397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.714656 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.714659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.715513 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.715515 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.715600 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.715603 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:05.715634 (+ 31us) client_negotiation.cc:240] Negotiation successful
0808 17:44:05.715678 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":44}
I20260808 17:44:05.715844 4440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.711796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35620 (local address 127.9.187.194:36771)
0808 17:44:05.712134 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.712139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.712150 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:44:05.712187 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.712190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.712204 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.712280 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:05.712491 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.713522 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.714777 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.715403 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.715461 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.715520 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:05.715726 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 17:44:05.715768 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":95,"threads_started":1}
I20260808 17:44:05.715965 4442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.711908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51602 (local address 127.9.187.195:46367)
0808 17:44:05.712063 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.712067 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.712075 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:05.712104 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.712105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.712117 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.712185 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:05.712292 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.713300 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.714740 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.715410 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.715753 (+ 343us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.715819 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:05.715845 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 17:44:05.715884 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260808 17:44:05.716091 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.711693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:36771 (local address 127.0.0.1:35620)
0808 17:44:05.711856 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:05.711867 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:05.711919 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:05.712368 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:05.712369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:05.712371 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:05.712409 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.712411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.713600 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.713601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.714683 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.714684 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.715486 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.715487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.715549 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.715571 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 17:44:05.715616 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:44:05.715654 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":101,"threads_started":1}
I20260808 17:44:05.716564 4330 tablet_service.cc:1467] Processing CreateTablet for tablet 351c70286e8246dc8607787952a5edcd (DEFAULT_TABLE table=test-table [id=dc62df3c8f8a42eaa4147c95d0af7025]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:05.716677 4104 tablet_service.cc:1467] Processing CreateTablet for tablet 351c70286e8246dc8607787952a5edcd (DEFAULT_TABLE table=test-table [id=dc62df3c8f8a42eaa4147c95d0af7025]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:05.716859 4330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 351c70286e8246dc8607787952a5edcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:05.716988 4104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 351c70286e8246dc8607787952a5edcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:05.719911 4446 tablet_bootstrap.cc:492] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8: Bootstrap starting.
I20260808 17:44:05.720110 4450 tablet_bootstrap.cc:492] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3: Bootstrap starting.
I20260808 17:44:05.720520 4446 tablet_bootstrap.cc:654] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:05.720634 4450 tablet_bootstrap.cc:654] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:05.721040 4446 log.cc:824] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:05.721146 4450 log.cc:824] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:05.721709 4446 tablet_bootstrap.cc:492] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8: No bootstrap required, opened a new log
I20260808 17:44:05.721771 4446 ts_tablet_manager.cc:1397] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:44:05.721819 4450 tablet_bootstrap.cc:492] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3: No bootstrap required, opened a new log
I20260808 17:44:05.721889 4450 ts_tablet_manager.cc:1397] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:44:05.723109 4446 raft_consensus.cc:348] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:05.723251 4446 raft_consensus.cc:374] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:05.723199 4450 raft_consensus.cc:348] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:05.723284 4446 raft_consensus.cc:729] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fffc11cf3b1443ccb55a8162d21229d8, State: Initialized, Role: FOLLOWER
I20260808 17:44:05.723336 4450 raft_consensus.cc:374] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:05.723376 4450 raft_consensus.cc:729] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c417502da8164ae18e15d8d3aa043cc3, State: Initialized, Role: FOLLOWER
I20260808 17:44:05.723407 4446 consensus_queue.cc:260] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:05.723483 4450 consensus_queue.cc:260] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:05.723670 4446 ts_tablet_manager.cc:1428] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:05.723696 4432 heartbeater.cc:503] Master 127.9.187.254:46251 was elected leader, sending a full tablet report...
I20260808 17:44:05.724058 4210 heartbeater.cc:503] Master 127.9.187.254:46251 was elected leader, sending a full tablet report...
I20260808 17:44:05.724103 4450 ts_tablet_manager.cc:1428] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:44:05.728622 4005 raft_consensus.cc:482] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:05.728724 4005 raft_consensus.cc:504] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:05.728986 4005 leader_election.cc:288] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367), c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771)
I20260808 17:44:05.731575 4440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.729154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:45453 (local address 127.9.187.194:36771)
0808 17:44:05.729289 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.729290 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.729325 (+ 35us) server_negotiation.cc:407] Connection header received
0808 17:44:05.729382 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.729383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.729390 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.729446 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:05.729568 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.729977 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.730923 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.731277 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.731341 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.731348 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:05.731489 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 17:44:05.731521 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260808 17:44:05.731577 4442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.729159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:57673 (local address 127.9.187.195:46367)
0808 17:44:05.729267 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.729269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.729277 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:05.729299 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.729300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.729308 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.729360 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:05.729500 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.729968 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.730899 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.731253 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.731303 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.731309 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:05.731480 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 17:44:05.731511 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 17:44:05.731581 4003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.729117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:46367 (local address 127.9.187.193:57673)
0808 17:44:05.729164 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:05.729174 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:05.729232 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:05.729374 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:05.729375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:05.729377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:05.729438 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.729440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.730037 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.730038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.730822 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.730824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.731324 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.731325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.731402 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.731423 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 17:44:05.731466 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:44:05.731505 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":15}
I20260808 17:44:05.731642 4457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.729123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:36771 (local address 127.9.187.193:45453)
0808 17:44:05.729272 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:05.729282 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:05.729339 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:05.729452 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:05.729453 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:05.729454 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:05.729514 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.729516 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.730050 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.730051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.730844 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:05.730847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.731369 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.731370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:05.731428 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.731431 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:05.731477 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:44:05.731516 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":13,"thread_start_us":84,"threads_started":1}
I20260808 17:44:05.731907 4138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351c70286e8246dc8607787952a5edcd" candidate_uuid: "b04d4c28162742ac9f424be01476586f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c417502da8164ae18e15d8d3aa043cc3" is_pre_election: true
I20260808 17:44:05.732002 4138 raft_consensus.cc:2454] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04d4c28162742ac9f424be01476586f in term 0.
I20260808 17:44:05.732153 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351c70286e8246dc8607787952a5edcd" candidate_uuid: "b04d4c28162742ac9f424be01476586f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fffc11cf3b1443ccb55a8162d21229d8" is_pre_election: true
I20260808 17:44:05.732168 3830 leader_election.cc:302] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04d4c28162742ac9f424be01476586f, c417502da8164ae18e15d8d3aa043cc3; no voters:
I20260808 17:44:05.732247 4362 raft_consensus.cc:2454] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04d4c28162742ac9f424be01476586f in term 0.
I20260808 17:44:05.732290 4005 raft_consensus.cc:2781] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:44:05.732353 4005 raft_consensus.cc:482] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:44:05.732376 4005 raft_consensus.cc:3037] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:05.732925 4005 raft_consensus.cc:504] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:05.733047 4005 leader_election.cc:288] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 1 election: Requested vote from peers fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367), c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771)
I20260808 17:44:05.733176 4138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351c70286e8246dc8607787952a5edcd" candidate_uuid: "b04d4c28162742ac9f424be01476586f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c417502da8164ae18e15d8d3aa043cc3"
I20260808 17:44:05.733244 4138 raft_consensus.cc:3037] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:05.733903 4138 raft_consensus.cc:2454] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04d4c28162742ac9f424be01476586f in term 1.
I20260808 17:44:05.733995 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351c70286e8246dc8607787952a5edcd" candidate_uuid: "b04d4c28162742ac9f424be01476586f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fffc11cf3b1443ccb55a8162d21229d8"
I20260808 17:44:05.734058 4362 raft_consensus.cc:3037] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:05.734058 3830 leader_election.cc:302] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04d4c28162742ac9f424be01476586f, c417502da8164ae18e15d8d3aa043cc3; no voters:
I20260808 17:44:05.734171 4005 raft_consensus.cc:2781] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:05.734308 4005 raft_consensus.cc:686] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 LEADER]: Becoming Leader. State: Replica: b04d4c28162742ac9f424be01476586f, State: Running, Role: LEADER
I20260808 17:44:05.734364 4005 consensus_queue.cc:237] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:05.734774 4362 raft_consensus.cc:2454] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04d4c28162742ac9f424be01476586f in term 1.
I20260808 17:44:05.734983 3702 catalog_manager.cc:5495] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04d4c28162742ac9f424be01476586f (127.9.187.193). New cstate: current_term: 1 leader_uuid: "b04d4c28162742ac9f424be01476586f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } health_report { overall_health: HEALTHY } } }
I20260808 17:44:05.743420 4010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.741271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38124 (local address 127.9.187.193:44483)
0808 17:44:05.741314 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:05.741315 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:05.741324 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:44:05.741390 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:05.741391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:05.741407 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:05.741467 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:44:05.741563 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.742003 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.742726 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:05.742935 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:05.742987 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:05.743137 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:44:05.743233 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:44:05.743291 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:05.743340 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 17:44:05.743360 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:44:05.744634 4362 raft_consensus.cc:1261] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8 [term 1 FOLLOWER]: Refusing update from remote peer b04d4c28162742ac9f424be01476586f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:05.744642 4138 raft_consensus.cc:1261] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3 [term 1 FOLLOWER]: Refusing update from remote peer b04d4c28162742ac9f424be01476586f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:05.744907 4458 consensus_queue.cc:1035] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:05.745014 4005 consensus_queue.cc:1035] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:05.749058 3702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:05.749135 3702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:05.749735 3702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Sending DeleteTablet for 3 replicas of tablet 351c70286e8246dc8607787952a5edcd
I20260808 17:44:05.750034 3894 tablet_service.cc:1514] Processing DeleteTablet for tablet 351c70286e8246dc8607787952a5edcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:05 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:47482
I20260808 17:44:05.750011 4104 tablet_service.cc:1514] Processing DeleteTablet for tablet 351c70286e8246dc8607787952a5edcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:05 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:35620
I20260808 17:44:05.750077 4330 tablet_service.cc:1514] Processing DeleteTablet for tablet 351c70286e8246dc8607787952a5edcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:05 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:51602
I20260808 17:44:05.750108 4012 tablet_replica.cc:330] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: stopping tablet replica
I20260808 17:44:05.750185 4012 raft_consensus.cc:2229] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:44:05.750257 4012 raft_consensus.cc:2258] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:05.750320 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 3771
I20260808 17:44:05.750582 4478 tablet_replica.cc:330] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8: stopping tablet replica
I20260808 17:44:05.750717 4478 raft_consensus.cc:2229] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:05.754881 4478 raft_consensus.cc:2258] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:05.756474 4478 ts_tablet_manager.cc:1905] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:05.758029 4478 ts_tablet_manager.cc:1918] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:05.758160 4478 log.cc:1196] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/351c70286e8246dc8607787952a5edcd
I20260808 17:44:05.758455 4478 ts_tablet_manager.cc:1939] T 351c70286e8246dc8607787952a5edcd P fffc11cf3b1443ccb55a8162d21229d8: Deleting consensus metadata
I20260808 17:44:05.758894 3676 catalog_manager.cc:4841] TS fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367): tablet 351c70286e8246dc8607787952a5edcd (table test-table [id=dc62df3c8f8a42eaa4147c95d0af7025]) successfully deleted
I20260808 17:44:05.761797 4481 tablet_replica.cc:330] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3: stopping tablet replica
I20260808 17:44:05.761886 4481 raft_consensus.cc:2229] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:05.761986 4481 raft_consensus.cc:2258] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:05.762912 4481 ts_tablet_manager.cc:1905] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:05.764564 4481 ts_tablet_manager.cc:1918] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:05.764623 4481 log.cc:1196] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/351c70286e8246dc8607787952a5edcd
I20260808 17:44:05.764861 4481 ts_tablet_manager.cc:1939] T 351c70286e8246dc8607787952a5edcd P c417502da8164ae18e15d8d3aa043cc3: Deleting consensus metadata
I20260808 17:44:05.765316 3680 catalog_manager.cc:4841] TS c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771): tablet 351c70286e8246dc8607787952a5edcd (table test-table [id=dc62df3c8f8a42eaa4147c95d0af7025]) successfully deleted
W20260808 17:44:05.767889 3680 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:44483 (error 108)
I20260808 17:44:05.768219 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 4007
I20260808 17:44:05.768338 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:05.768209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:44483 (local address 127.0.0.1:38126)
0808 17:44:05.768260 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:05.768305 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:44483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 17:44:05.772564 3680 catalog_manager.cc:4584] TS b04d4c28162742ac9f424be01476586f (127.9.187.193:44483): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 351c70286e8246dc8607787952a5edcd: Network error: Client connection negotiation failed: client connection to 127.9.187.193:44483: connect: Connection refused (error 111)
I20260808 17:44:05.778430 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 4217
I20260808 17:44:05.791352 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 3651
I20260808 17:44:25.799621 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46251
--webserver_interface=127.9.187.254
--webserver_port=45613
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:46251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:25.882189 4483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:25.882377 4483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:25.882406 4483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:25.883491 4483 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 17:44:25.883536 4483 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 17:44:25.883553 4483 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 17:44:25.883569 4483 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:25.883584 4483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:25.883607 4483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:25.883631 4483 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:25.883647 4483 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:25.885082 4483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:46251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=45613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:25.885331 4483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:25.885545 4483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:25.890348 4488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:25.890404 4494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:25.890364 4489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:25.890395 4483 server_base.cc:1034] running on GCE node
I20260808 17:44:25.890848 4483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:25.891103 4483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:25.892266 4483 hybrid_clock.cc:648] HybridClock initialized: now 1786211065892251 us; error 28 us; skew 500 ppm
Aug 08 17:44:25 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211065, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:25.897876 4483 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:44:25.898345 4483 webserver.cc:460] Webserver started at http://127.9.187.254:45613/ using document root <none> and password file <none>
I20260808 17:44:25.898568 4483 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:25.898618 4483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:25.899883 4483 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:44:25.900516 4507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:25.900662 4483 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:25.900748 4483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "f5058378d4d34b4b933a31e33bc1b002"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "a7b8edce55f4ab1b81fb99165c5cdcaa"
server_key_iv: "b5425115730704bdce4d8c03a60db5e8"
server_key_version: "encryptionkey@0"
I20260808 17:44:25.901054 4483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:25.919149 4483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:25.921132 4483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:25.921262 4483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:25.925295 4483 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:46251
I20260808 17:44:25.925334 4596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:46251 every 8 connection(s)
I20260808 17:44:25.925678 4483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:25.926044 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 4483
I20260808 17:44:25.926386 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:44483
--local_ip_for_outbound_sockets=127.9.187.193
--tserver_master_addrs=127.9.187.254:46251
--webserver_port=39213
--webserver_interface=127.9.187.193
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:44:25.927429 4597 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:44:25.928277 4597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Bootstrap starting.
I20260808 17:44:25.938977 4597 log.cc:824] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:25.941866 4597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:44:25.942225 4597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Bootstrap complete.
I20260808 17:44:25.945189 4597 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:44:25.945500 4597 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5058378d4d34b4b933a31e33bc1b002, State: Initialized, Role: FOLLOWER
I20260808 17:44:25.945657 4597 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:44:25.945719 4597 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:25.945760 4597 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:25.945802 4597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 2 FOLLOWER]: Advancing to term 3
I20260808 17:44:25.947064 4597 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:44:25.947171 4597 leader_election.cc:302] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5058378d4d34b4b933a31e33bc1b002; no voters:
I20260808 17:44:25.947332 4597 leader_election.cc:288] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 17:44:25.947391 4604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 17:44:25.947568 4597 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:25.947623 4604 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [term 3 LEADER]: Becoming Leader. State: Replica: f5058378d4d34b4b933a31e33bc1b002, State: Running, Role: LEADER
I20260808 17:44:25.947806 4604 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } }
I20260808 17:44:25.948093 4605 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f5058378d4d34b4b933a31e33bc1b002" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } } }
I20260808 17:44:25.948169 4605 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:25.948664 4606 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5058378d4d34b4b933a31e33bc1b002. Latest consensus state: current_term: 3 leader_uuid: "f5058378d4d34b4b933a31e33bc1b002" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5058378d4d34b4b933a31e33bc1b002" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46251 } } }
I20260808 17:44:25.948721 4618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:25.948735 4606 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:25.949494 4618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:25.949669 4618 catalog_manager.cc:1259] Loaded cluster ID: 3c5cefc3c0be4e1181e967c972d3f3c9
I20260808 17:44:25.949777 4618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:25.950977 4618 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:25.951164 4618 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Loaded TSK: 0
I20260808 17:44:25.951215 4618 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f5058378d4d34b4b933a31e33bc1b002: Loaded TSK: 1
F20260808 17:44:25.951491 4618 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f20229659ad google::LogMessage::Fail() at ??:0
@ 0x7f202296888a google::LogMessage::SendToLog() at ??:0
@ 0x7f20229654de google::LogMessage::Flush() at ??:0
@ 0x7f2022966a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f20250d2104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f20250cfd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f202a8c31cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f202a8c348e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f202a8c3594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f202a889c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f202a893ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f20248330d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2024828954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f202568c6db start_thread at ??:0
@ 0x7f202146361f clone at ??:0
W20260808 17:44:26.030104 4600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:26.030369 4600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:26.030395 4600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:26.031545 4600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:26.031589 4600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:26.031615 4600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:44:26.033046 4600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:44483
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=39213
--tserver_master_addrs=127.9.187.254:46251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:26.033277 4600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:26.033493 4600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:26.038337 4670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:26.038327 4666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:26.038327 4668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:26.038754 4600 server_base.cc:1034] running on GCE node
I20260808 17:44:26.038945 4600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:26.039180 4600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:26.040328 4600 hybrid_clock.cc:648] HybridClock initialized: now 1786211066040314 us; error 31 us; skew 500 ppm
Aug 08 17:44:26 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211066, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:26.042825 4600 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:44:26.043272 4600 webserver.cc:460] Webserver started at http://127.9.187.193:39213/ using document root <none> and password file <none>
I20260808 17:44:26.043493 4600 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:26.043541 4600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:26.044852 4600 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:44:26.045547 4678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:26.045696 4600 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:44:26.045779 4600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "b04d4c28162742ac9f424be01476586f"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "821b23597478ee4f78d5716867c7771d"
server_key_iv: "5ea0567c4397b2a228aace95405c303e"
server_key_version: "encryptionkey@0"
I20260808 17:44:26.046118 4600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:26.059243 4600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:26.061345 4600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:26.061480 4600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:26.061689 4600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:26.062153 4694 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 17:44:26.064203 4600 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 17:44:26.064254 4600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 17:44:26.064288 4600 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 17:44:26.064893 4600 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 17:44:26.064926 4600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 17:44:26.065017 4694 tablet_bootstrap.cc:492] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: Bootstrap starting.
I20260808 17:44:26.071580 4600 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:44483
I20260808 17:44:26.071750 4867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:44483 every 8 connection(s)
I20260808 17:44:26.071997 4600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:44:26.073170 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 4600
I20260808 17:44:26.073458 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:36771
--local_ip_for_outbound_sockets=127.9.187.194
--tserver_master_addrs=127.9.187.254:46251
--webserver_port=42281
--webserver_interface=127.9.187.194
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:44:26.075951 4694 log.cc:824] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:26.078866 4694 tablet_bootstrap.cc:492] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:44:26.079190 4694 tablet_bootstrap.cc:492] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: Bootstrap complete.
I20260808 17:44:26.080300 4694 ts_tablet_manager.cc:1397] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260808 17:44:26.081732 4694 raft_consensus.cc:348] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:26.082063 4694 raft_consensus.cc:729] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04d4c28162742ac9f424be01476586f, State: Initialized, Role: FOLLOWER
I20260808 17:44:26.082257 4694 consensus_queue.cc:260] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:26.082535 4694 ts_tablet_manager.cc:1428] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f: Time spent starting tablet: real 0.002s user 0.001s sys 0.003s
W20260808 17:44:26.145043 4871 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:44:26.072625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:38131)
0808 17:44:26.072790 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:26.072833 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:26.073434 (+ 601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:26.144853 (+ 71419us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":73,"threads_started":1}
W20260808 17:44:26.145311 4869 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:46251 (0 consecutive failures): Network error: Failed to ping master at 127.9.187.254:46251: Client connection negotiation failed: client connection to 127.9.187.254:46251: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 17:44:26.145668 4871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:26.145558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:54419)
0808 17:44:26.145606 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:26.145646 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:44:26.146000 4871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:26.145925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:56587)
0808 17:44:26.145964 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:26.145985 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:44:26.146118 4869 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:44:26.158478 4872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:26.158651 4872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:26.158674 4872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:26.159741 4872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:26.159773 4872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:26.159818 4872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:44:26.161198 4872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:36771
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=42281
--tserver_master_addrs=127.9.187.254:46251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:26.161367 4872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:26.161535 4872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:26.166149 4889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:26.166162 4885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:26.166147 4883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:26.166370 4872 server_base.cc:1034] running on GCE node
I20260808 17:44:26.166563 4872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:26.166788 4872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:26.167930 4872 hybrid_clock.cc:648] HybridClock initialized: now 1786211066167918 us; error 31 us; skew 500 ppm
Aug 08 17:44:26 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211066, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:26.170305 4872 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:44:26.170697 4872 webserver.cc:460] Webserver started at http://127.9.187.194:42281/ using document root <none> and password file <none>
I20260808 17:44:26.170879 4872 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:26.170918 4872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:26.172101 4872 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:44:26.172657 4897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:26.172806 4872 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:44:26.172876 4872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "c417502da8164ae18e15d8d3aa043cc3"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "1f7bd115e7eb480ece093cdf2aeba732"
server_key_iv: "c17a9e2e23244a093b3a55fe2944dd29"
server_key_version: "encryptionkey@0"
I20260808 17:44:26.173189 4872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:26.187237 4872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:26.188853 4872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:26.188975 4872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:26.189170 4872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:26.189428 4872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:26.189461 4872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:26.189488 4872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:26.189512 4872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:26.195011 4872 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:36771
I20260808 17:44:26.195072 5079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:36771 every 8 connection(s)
I20260808 17:44:26.195366 4872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:44:26.196302 5084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:26.195966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:43847)
0808 17:44:26.196102 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:26.196171 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":69,"threads_started":1}
W20260808 17:44:26.196668 5081 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:46251 (0 consecutive failures): Network error: Failed to ping master at 127.9.187.254:46251: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
I20260808 17:44:26.196897 5084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:26.196818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:47037)
0808 17:44:26.196854 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:26.196879 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 17:44:26.197105 5084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:26.197046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:59877)
0808 17:44:26.197075 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:26.197093 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260808 17:44:26.197184 5081 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 17:44:26.200409 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 4872
I20260808 17:44:26.200701 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:46367
--local_ip_for_outbound_sockets=127.9.187.195
--tserver_master_addrs=127.9.187.254:46251
--webserver_port=45209
--webserver_interface=127.9.187.195
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:37837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:26.281291 5085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:26.281482 5085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:26.281504 5085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:26.282622 5085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:26.282671 5085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:26.282696 5085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:44:26.284085 5085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:37837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:46367
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=45209
--tserver_master_addrs=127.9.187.254:46251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:26.284303 5085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:26.284514 5085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:26.289256 5094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:26.289314 5085 server_base.cc:1034] running on GCE node
W20260808 17:44:26.289265 5097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:26.289265 5100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:26.289788 5085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:26.289985 5085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:26.291115 5085 hybrid_clock.cc:648] HybridClock initialized: now 1786211066291100 us; error 31 us; skew 500 ppm
Aug 08 17:44:26 dist-test-slave-bqcl krb5kdc[2801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211066, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:26.293375 5085 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:44:26.293785 5085 webserver.cc:460] Webserver started at http://127.9.187.195:45209/ using document root <none> and password file <none>
I20260808 17:44:26.293998 5085 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:26.294046 5085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:26.295292 5085 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:44:26.295863 5111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:26.296000 5085 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:44:26.296082 5085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "fffc11cf3b1443ccb55a8162d21229d8"
format_stamp: "Formatted at 2026-08-08 17:43:44 on dist-test-slave-bqcl"
server_key: "6ef31ae8ea7162e05bd81c07a36f1517"
server_key_iv: "d60e2adeebf47d1ff96d13b09abeadfc"
server_key_version: "encryptionkey@0"
I20260808 17:44:26.296391 5085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:26.326412 5085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:26.328049 5085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:26.328181 5085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:26.328390 5085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:26.328679 5085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:26.328713 5085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:26.328740 5085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:26.328758 5085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:26.334170 5085 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:46367
I20260808 17:44:26.334246 5284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:46367 every 8 connection(s)
I20260808 17:44:26.334533 5085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:44:26.335448 5288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:26.335111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:52781)
0808 17:44:26.335247 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:26.335312 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":70,"threads_started":1}
W20260808 17:44:26.335806 5285 heartbeater.cc:644] Failed to heartbeat to 127.9.187.254:46251 (0 consecutive failures): Network error: Failed to ping master at 127.9.187.254:46251: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
I20260808 17:44:26.336045 5288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:26.335964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:53449)
0808 17:44:26.336003 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:26.336028 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 17:44:26.336221 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 5085
I20260808 17:44:26.336333 5288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:26.336251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:44387)
0808 17:44:26.336290 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:26.336316 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 17:44:26.336443 5285 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:44:27.072978 4860 messenger.cc:188] Invalid argument: socket address is ambiguous: no data on pending connections for acceptor pool at 127.9.187.193:44483
I20260808 17:44:27.146705 5292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:27.146472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:48505)
0808 17:44:27.146602 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:27.146639 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":62,"threads_started":1}
I20260808 17:44:27.197719 5297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:27.197487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:60791)
0808 17:44:27.197634 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:27.197667 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":80,"threads_started":1}
I20260808 17:44:27.262305 5300 raft_consensus.cc:482] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:27.262423 5300 raft_consensus.cc:504] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:27.262707 5300 leader_election.cc:288] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367), c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771)
Aug 08 17:44:27 dist-test-slave-bqcl krb5kdc[2801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211066, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.194@KRBTEST.COM
Aug 08 17:44:27 dist-test-slave-bqcl krb5kdc[2801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211066, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.195@KRBTEST.COM
I20260808 17:44:27.272905 5304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:27.263019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:49585 (local address 127.9.187.195:46367)
0808 17:44:27.263178 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:27.263187 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:27.263205 (+ 18us) server_negotiation.cc:407] Connection header received
0808 17:44:27.263634 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:27.263636 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:27.263694 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:27.263816 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:27.264508 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:27.265390 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:27.266417 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:27.266801 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:27.266896 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:27.269619 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:27.269622 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:27.269622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:27.269632 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:27.271266 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:27.271629 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:27.271632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:27.271632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:27.271733 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:27.271927 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:27.271928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:27.271929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:27.272240 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:27.272328 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:27.272652 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 17:44:27.272788 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":48,"threads_started":1}
I20260808 17:44:27.272900 5303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:27.262984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:53129 (local address 127.9.187.194:36771)
0808 17:44:27.263140 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:27.263153 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:27.263183 (+ 30us) server_negotiation.cc:407] Connection header received
0808 17:44:27.263623 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:27.263625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:27.263668 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:27.263782 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:27.264499 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:27.265382 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:27.266416 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:27.266795 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:27.266895 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:27.269269 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:27.269273 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:27.269273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:27.269283 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:27.271101 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:27.271550 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:27.271554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:27.271554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:27.271666 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:27.271929 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:27.271930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:27.271931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:27.272240 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:27.272328 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:27.272652 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 17:44:27.272788 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":58,"threads_started":1}
I20260808 17:44:27.272886 5302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:27.262849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:46367 (local address 127.9.187.193:49585)
0808 17:44:27.262994 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:27.263004 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:27.263058 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:27.263848 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:27.263851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:27.264198 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:27.264393 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:27.264398 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:27.265500 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:27.265500 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:27.266339 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:27.266342 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:27.266882 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:27.266883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:27.266989 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:27.267567 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:27.267576 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:27.269518 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:27.271332 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:27.271333 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:27.271333 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:27.271543 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:27.271798 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:27.271799 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:27.271799 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:27.271861 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:27.272310 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:27.272316 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:27.272468 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 17:44:27.272579 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 17:44:27.272757 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":83,"thread_start_us":69,"threads_started":1}
I20260808 17:44:27.272948 5292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:27.262848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:36771 (local address 127.9.187.193:53129)
0808 17:44:27.262897 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:27.262910 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:27.262973 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:27.263847 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:27.263850 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:27.264199 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:27.264393 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:27.264399 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:27.265478 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:27.265479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:27.266338 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:27.266341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:27.266877 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:27.266878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:27.266989 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:27.267573 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:27.267578 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:27.269160 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:27.271176 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:27.271183 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:27.271184 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:27.271445 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:27.271732 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:27.271732 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:27.271732 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:27.271860 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:27.272310 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:27.272316 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:27.272468 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 17:44:27.272594 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 17:44:27.272822 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":162}
W20260808 17:44:27.273846 4691 leader_election.cc:341] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771): Not found: Tablet not found: 351c70286e8246dc8607787952a5edcd
W20260808 17:44:27.273937 4684 leader_election.cc:341] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367): Not found: Tablet not found: 351c70286e8246dc8607787952a5edcd
I20260808 17:44:27.273988 4684 leader_election.cc:302] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b04d4c28162742ac9f424be01476586f; no voters: c417502da8164ae18e15d8d3aa043cc3, fffc11cf3b1443ccb55a8162d21229d8
I20260808 17:44:27.274083 5300 raft_consensus.cc:2726] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:44:27.336932 5306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:27.336732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:56979)
0808 17:44:27.336849 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:27.336894 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":75,"threads_started":1}
I20260808 17:44:28.147323 5307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:28.147113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:51803)
0808 17:44:28.147240 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:28.147275 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":67,"threads_started":1}
I20260808 17:44:28.198365 5309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:28.198103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:48193)
0808 17:44:28.198269 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:28.198324 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":87,"threads_started":1}
I20260808 17:44:28.337606 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:28.337379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:42453)
0808 17:44:28.337496 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:28.337532 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":65,"threads_started":1}
I20260808 17:44:28.893859 5311 raft_consensus.cc:482] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:28.893953 5311 raft_consensus.cc:504] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:28.894163 5311 leader_election.cc:288] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367), c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771)
W20260808 17:44:28.894501 4684 leader_election.cc:341] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367): Not found: Tablet not found: 351c70286e8246dc8607787952a5edcd
W20260808 17:44:28.894598 4691 leader_election.cc:341] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771): Not found: Tablet not found: 351c70286e8246dc8607787952a5edcd
I20260808 17:44:28.894709 4691 leader_election.cc:302] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b04d4c28162742ac9f424be01476586f; no voters: c417502da8164ae18e15d8d3aa043cc3, fffc11cf3b1443ccb55a8162d21229d8
I20260808 17:44:28.894793 5311 raft_consensus.cc:2726] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:44:29.148062 5314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:29.147811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:42871)
0808 17:44:29.147956 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:29.147991 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260808 17:44:29.198962 5316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:29.198755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:56373)
0808 17:44:29.198885 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:29.198921 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260808 17:44:29.338289 5317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:29.338039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:56393)
0808 17:44:29.338199 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:29.338242 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":108,"threads_started":1}
I20260808 17:44:30.148805 5319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:30.148577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:50597)
0808 17:44:30.148709 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:30.148757 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
I20260808 17:44:30.199613 5320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:30.199366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:47237)
0808 17:44:30.199505 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:30.199573 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
I20260808 17:44:30.339031 5325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:30.338775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:37001)
0808 17:44:30.338937 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:30.338985 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":67,"threads_started":1}
I20260808 17:44:30.440783 5327 raft_consensus.cc:482] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:30.440876 5327 raft_consensus.cc:504] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:30.441063 5327 leader_election.cc:288] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367), c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771)
W20260808 17:44:30.441382 4691 leader_election.cc:341] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771): Not found: Tablet not found: 351c70286e8246dc8607787952a5edcd
W20260808 17:44:30.441473 4684 leader_election.cc:341] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367): Not found: Tablet not found: 351c70286e8246dc8607787952a5edcd
I20260808 17:44:30.441535 4684 leader_election.cc:302] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b04d4c28162742ac9f424be01476586f; no voters: c417502da8164ae18e15d8d3aa043cc3, fffc11cf3b1443ccb55a8162d21229d8
I20260808 17:44:30.441615 5327 raft_consensus.cc:2726] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:44:31.149525 5328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:31.149294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:53833)
0808 17:44:31.149416 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:31.149454 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
I20260808 17:44:31.200219 5331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:31.200026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:57173)
0808 17:44:31.200140 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:31.200175 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":66,"threads_started":1}
I20260808 17:44:31.339697 5332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:31.339449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:53577)
0808 17:44:31.339613 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:31.339653 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":81,"threads_started":1}
I20260808 17:44:32.150102 5336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:32.149903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:53585)
0808 17:44:32.150019 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:32.150055 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":61,"threads_started":1}
I20260808 17:44:32.200824 5337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:32.200636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:38967)
0808 17:44:32.200746 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:32.200780 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":59,"threads_started":1}
I20260808 17:44:32.340375 5338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:32.340120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:39173)
0808 17:44:32.340286 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:32.340326 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":86,"threads_started":1}
I20260808 17:44:33.150750 5342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:33.150514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:53899)
0808 17:44:33.150667 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:33.150702 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":103,"threads_started":1}
I20260808 17:44:33.201375 5343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:33.201184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:33635)
0808 17:44:33.201301 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:33.201335 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":65,"threads_started":1}
I20260808 17:44:33.341131 5344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:33.340873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:41549)
0808 17:44:33.341030 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:33.341075 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":85,"threads_started":1}
I20260808 17:44:34.151337 5345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:34.151130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:45395)
0808 17:44:34.151250 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:34.151288 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":85,"threads_started":1}
I20260808 17:44:34.201949 5346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:34.201765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:51395)
0808 17:44:34.201878 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:34.201910 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":60,"threads_started":1}
I20260808 17:44:34.341827 5348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:34.341614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:44577)
0808 17:44:34.341746 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:34.341781 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
I20260808 17:44:34.652716 5349 raft_consensus.cc:482] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:34.652819 5349 raft_consensus.cc:504] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:34.652984 5349 leader_election.cc:288] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367), c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771)
W20260808 17:44:34.653378 4684 leader_election.cc:341] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367): Not found: Tablet not found: 351c70286e8246dc8607787952a5edcd
W20260808 17:44:34.653486 4691 leader_election.cc:341] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771): Not found: Tablet not found: 351c70286e8246dc8607787952a5edcd
I20260808 17:44:34.653529 4691 leader_election.cc:302] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b04d4c28162742ac9f424be01476586f; no voters: c417502da8164ae18e15d8d3aa043cc3, fffc11cf3b1443ccb55a8162d21229d8
I20260808 17:44:34.653590 5349 raft_consensus.cc:2726] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:44:35.151942 5350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:35.151728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:34261)
0808 17:44:35.151853 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:35.151890 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260808 17:44:35.202528 5351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:35.202304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:36383)
0808 17:44:35.202443 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:35.202484 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260808 17:44:35.342440 5352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:35.342243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:54971)
0808 17:44:35.342361 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:35.342396 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260808 17:44:36.152577 5353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:36.152354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:56227)
0808 17:44:36.152475 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:36.152513 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
I20260808 17:44:36.203131 5354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:36.202905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:47609)
0808 17:44:36.203051 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:36.203087 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260808 17:44:36.343058 5355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:36.342817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:37613)
0808 17:44:36.342974 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:36.343015 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":80,"threads_started":1}
I20260808 17:44:36.613930 5356 raft_consensus.cc:482] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:36.614032 5356 raft_consensus.cc:504] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fffc11cf3b1443ccb55a8162d21229d8" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 46367 } } peers { permanent_uuid: "c417502da8164ae18e15d8d3aa043cc3" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36771 } } peers { permanent_uuid: "b04d4c28162742ac9f424be01476586f" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 44483 } }
I20260808 17:44:36.614243 5356 leader_election.cc:288] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367), c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771)
W20260808 17:44:36.614634 4684 leader_election.cc:341] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fffc11cf3b1443ccb55a8162d21229d8 (127.9.187.195:46367): Not found: Tablet not found: 351c70286e8246dc8607787952a5edcd
W20260808 17:44:36.614728 4691 leader_election.cc:341] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c417502da8164ae18e15d8d3aa043cc3 (127.9.187.194:36771): Not found: Tablet not found: 351c70286e8246dc8607787952a5edcd
I20260808 17:44:36.614773 4691 leader_election.cc:302] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b04d4c28162742ac9f424be01476586f; no voters: c417502da8164ae18e15d8d3aa043cc3, fffc11cf3b1443ccb55a8162d21229d8
I20260808 17:44:36.614841 5356 raft_consensus.cc:2726] T 351c70286e8246dc8607787952a5edcd P b04d4c28162742ac9f424be01476586f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:44:37.153177 5358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:37.152947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:50381)
0808 17:44:37.153091 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:37.153127 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":63,"threads_started":1}
I20260808 17:44:37.203725 5359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:37.203507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:45689)
0808 17:44:37.203635 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:37.203669 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260808 17:44:37.343685 5360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:37.343470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:34419)
0808 17:44:37.343603 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:37.343639 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":79,"threads_started":1}
I20260808 17:44:38.153808 5362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:38.153605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:38981)
0808 17:44:38.153723 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:38.153760 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260808 17:44:38.204324 5363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:38.204104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:38839)
0808 17:44:38.204242 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:38.204278 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
I20260808 17:44:38.344260 5364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:38.344073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:60247)
0808 17:44:38.344190 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:38.344220 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":61,"threads_started":1}
I20260808 17:44:39.154521 5365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:39.154309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:49581)
0808 17:44:39.154439 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:39.154470 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
I20260808 17:44:39.205013 5370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:39.204754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:51607)
0808 17:44:39.204914 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:39.204959 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":95,"threads_started":1}
I20260808 17:44:39.344880 5371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:39.344624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:53699)
0808 17:44:39.344791 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:39.344833 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":80,"threads_started":1}
I20260808 17:44:40.155119 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:40.154916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:38233)
0808 17:44:40.155034 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:40.155068 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":70,"threads_started":1}
I20260808 17:44:40.205698 5373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:40.205468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:40745)
0808 17:44:40.205613 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:40.205648 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260808 17:44:40.345525 5375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:40.345311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:38785)
0808 17:44:40.345447 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:40.345481 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
I20260808 17:44:41.155766 5377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:41.155558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.193:48493)
0808 17:44:41.155680 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:41.155718 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260808 17:44:41.206367 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:41.206185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.194:60587)
0808 17:44:41.206290 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:41.206322 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":56,"threads_started":1}
I20260808 17:44:41.345767 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 4600
I20260808 17:44:41.350356 5380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:41.346005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:46251 (local address 127.9.187.195:59927)
0808 17:44:41.350270 (+ 4265us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:41.350306 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.254:46251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4246,"thread_start_us":51,"threads_started":1}
I20260808 17:44:41.359429 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 4872
I20260808 17:44:41.372679 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 5085
2026-08-08T17:44:41Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58409 ms)
[----------] 30 tests from SecurityITest (232625 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:44:41 dist-test-slave-bqcl krb5kdc[5385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:44:41 dist-test-slave-bqcl krb5kdc[5385](info): set up 2 sockets
Aug 08 17:44:41 dist-test-slave-bqcl krb5kdc[5385](info): commencing operation
krb5kdc: starting...
W20260808 17:44:42.580327 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:44:42 dist-test-slave-bqcl krb5kdc[5385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:44:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:44:42.695060 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:36293
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:36293
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:42.777119 5412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:42.777321 5412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:42.777343 5412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:42.778468 5412 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:42.778508 5412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:42.778522 5412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:42.778533 5412 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:42.778548 5412 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:42.779966 5412 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:36293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:36293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:42.780179 5412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:42.780395 5412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:42.785564 5419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:42.785564 5424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:42.785637 5421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:42.785730 5412 server_base.cc:1034] running on GCE node
I20260808 17:44:42.786096 5412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:42.786406 5412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:42.787534 5412 hybrid_clock.cc:648] HybridClock initialized: now 1786211082787524 us; error 27 us; skew 500 ppm
Aug 08 17:44:42 dist-test-slave-bqcl krb5kdc[5385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211082, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:42.789980 5412 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:44:42.790447 5412 webserver.cc:460] Webserver started at http://127.9.187.254:36511/ using document root <none> and password file <none>
I20260808 17:44:42.790663 5412 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:42.790709 5412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:42.790840 5412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:42.791823 5412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "7e7abfbb73c747e5abe0fa944f85d054"
format_stamp: "Formatted at 2026-08-08 17:44:42 on dist-test-slave-bqcl"
server_key: "6554ccaa2eddbf396d4e0de41931fc8a"
server_key_iv: "bc67432dd285e194a0b9d7824ed14040"
server_key_version: "encryptionkey@0"
I20260808 17:44:42.792145 5412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "7e7abfbb73c747e5abe0fa944f85d054"
format_stamp: "Formatted at 2026-08-08 17:44:42 on dist-test-slave-bqcl"
server_key: "6554ccaa2eddbf396d4e0de41931fc8a"
server_key_iv: "bc67432dd285e194a0b9d7824ed14040"
server_key_version: "encryptionkey@0"
I20260808 17:44:42.793334 5412 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:44:42.793951 5433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:42.794098 5412 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:44:42.794209 5412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "7e7abfbb73c747e5abe0fa944f85d054"
format_stamp: "Formatted at 2026-08-08 17:44:42 on dist-test-slave-bqcl"
server_key: "6554ccaa2eddbf396d4e0de41931fc8a"
server_key_iv: "bc67432dd285e194a0b9d7824ed14040"
server_key_version: "encryptionkey@0"
I20260808 17:44:42.794268 5412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:42.807597 5412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:42.809356 5412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:42.809463 5412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:42.813247 5412 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:36293
I20260808 17:44:42.813302 5518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:36293 every 8 connection(s)
I20260808 17:44:42.813592 5412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:42.814440 5520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:42.816608 5520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054: Bootstrap starting.
I20260808 17:44:42.817145 5520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:42.817410 5520 log.cc:824] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:42.818024 5520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054: No bootstrap required, opened a new log
I20260808 17:44:42.819561 5520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e7abfbb73c747e5abe0fa944f85d054" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36293 } }
I20260808 17:44:42.819700 5520 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:42.819734 5520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e7abfbb73c747e5abe0fa944f85d054, State: Initialized, Role: FOLLOWER
I20260808 17:44:42.819864 5520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e7abfbb73c747e5abe0fa944f85d054" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36293 } }
I20260808 17:44:42.819922 5520 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:42.819944 5520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:42.819988 5520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:42.820302 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 5412
I20260808 17:44:42.820428 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:42.820597 5520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e7abfbb73c747e5abe0fa944f85d054" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36293 } }
I20260808 17:44:42.820622 9967 external_mini_cluster.cc:1428] Setting key 4f7ee68004f79513476427ce331bd6a0
I20260808 17:44:42.820700 5520 leader_election.cc:302] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e7abfbb73c747e5abe0fa944f85d054; no voters:
I20260808 17:44:42.820859 5520 leader_election.cc:288] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:42.820895 5526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:42.821009 5526 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [term 1 LEADER]: Becoming Leader. State: Replica: 7e7abfbb73c747e5abe0fa944f85d054, State: Running, Role: LEADER
I20260808 17:44:42.821153 5526 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e7abfbb73c747e5abe0fa944f85d054" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36293 } }
I20260808 17:44:42.821331 5520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:42.821666 5529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e7abfbb73c747e5abe0fa944f85d054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e7abfbb73c747e5abe0fa944f85d054" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36293 } } }
I20260808 17:44:42.821758 5529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:42.822278 5533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e7abfbb73c747e5abe0fa944f85d054. Latest consensus state: current_term: 1 leader_uuid: "7e7abfbb73c747e5abe0fa944f85d054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e7abfbb73c747e5abe0fa944f85d054" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36293 } } }
I20260808 17:44:42.822444 5533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:42.822610 5543 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:42.823110 5543 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:42.824385 5543 catalog_manager.cc:1347] Generated new cluster ID: b35e94ddf19d45968e8cb46ccf90049d
I20260808 17:44:42.824437 5543 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:44:42 dist-test-slave-bqcl krb5kdc[5385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:42.832616 5538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:42.821107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60134 (local address 127.9.187.254:36293)
0808 17:44:42.821262 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:42.821272 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:42.821491 (+ 219us) server_negotiation.cc:407] Connection header received
0808 17:44:42.821609 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:42.821616 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:42.821679 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:42.821811 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:42.822626 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:42.824082 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:42.825139 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:42.825778 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:42.825895 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:42.828464 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:42.828468 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:42.828469 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:42.828480 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:42.830966 (+ 2486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:42.831323 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:42.831326 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:42.831326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:42.831447 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:42.831617 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:42.831617 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:42.831618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:42.831917 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:42.832081 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:42.832146 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 17:44:42.832392 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":69,"threads_started":1}
I20260808 17:44:42.836023 5543 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:42.836483 5543 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:42.839390 5543 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054: Generated new TSK 0
I20260808 17:44:42.839535 5543 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:44:42.868719 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36293
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:42.949182 5564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:42.949389 5564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:42.949411 5564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:42.950510 5564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:42.950541 5564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:42.950565 5564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:44:42.951937 5564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:42.952121 5564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:42.952306 5564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:42.957218 5577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:42.957214 5575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:42.957212 5572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:42.957358 5564 server_base.cc:1034] running on GCE node
I20260808 17:44:42.957640 5564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:42.957903 5564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:42.959045 5564 hybrid_clock.cc:648] HybridClock initialized: now 1786211082959027 us; error 34 us; skew 500 ppm
Aug 08 17:44:42 dist-test-slave-bqcl krb5kdc[5385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211082, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:42.961491 5564 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:44:42.961894 5564 webserver.cc:460] Webserver started at http://127.9.187.193:42371/ using document root <none> and password file <none>
I20260808 17:44:42.962069 5564 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:42.962107 5564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:42.962265 5564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:42.963248 5564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "9fa6026398864f8e8b3e28dd530a3507"
format_stamp: "Formatted at 2026-08-08 17:44:42 on dist-test-slave-bqcl"
server_key: "05247b9ad6465e8bf3c79f6b4ccdbc9b"
server_key_iv: "99c0ea74bcc51ccfbac9ce906e714371"
server_key_version: "encryptionkey@0"
I20260808 17:44:42.963547 5564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "9fa6026398864f8e8b3e28dd530a3507"
format_stamp: "Formatted at 2026-08-08 17:44:42 on dist-test-slave-bqcl"
server_key: "05247b9ad6465e8bf3c79f6b4ccdbc9b"
server_key_iv: "99c0ea74bcc51ccfbac9ce906e714371"
server_key_version: "encryptionkey@0"
I20260808 17:44:42.964744 5564 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:44:42.965418 5587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:42.965583 5564 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:42.965664 5564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "9fa6026398864f8e8b3e28dd530a3507"
format_stamp: "Formatted at 2026-08-08 17:44:42 on dist-test-slave-bqcl"
server_key: "05247b9ad6465e8bf3c79f6b4ccdbc9b"
server_key_iv: "99c0ea74bcc51ccfbac9ce906e714371"
server_key_version: "encryptionkey@0"
I20260808 17:44:42.965720 5564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:42.973673 5564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:42.975666 5564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:42.975771 5564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:42.975929 5564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:42.976166 5564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:42.976202 5564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:42.976228 5564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:42.976244 5564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:42.981540 5564 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:33085
I20260808 17:44:42.981590 5770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:33085 every 8 connection(s)
I20260808 17:44:42.981868 5564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:44:42.983328 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 5564
I20260808 17:44:42.983434 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:44:42.983610 9967 external_mini_cluster.cc:1428] Setting key 2f0e51b0fc6c74a1d9edb54166e796b1
Aug 08 17:44:42 dist-test-slave-bqcl krb5kdc[5385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211082, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:42.991677 5538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:42.982507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:60867 (local address 127.9.187.254:36293)
0808 17:44:42.982564 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:42.982566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:42.982774 (+ 208us) server_negotiation.cc:407] Connection header received
0808 17:44:42.983795 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:42.983796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:42.983809 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:42.983867 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:42.985064 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:42.985569 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:42.986731 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:42.987018 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:42.987087 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:42.989133 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:42.989135 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:42.989135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:42.989142 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:42.990453 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:42.990815 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:42.990816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:42.990817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:42.990871 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:42.991077 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:42.991078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:42.991078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:42.991186 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:42.991248 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:42.991503 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 17:44:42.991589 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:44:42.991837 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:42.982470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:36293 (local address 127.9.187.193:60867)
0808 17:44:42.982649 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:42.982684 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:42.983134 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:42.983964 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:42.983969 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:42.984700 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:42.984960 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:42.984967 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:42.985653 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:42.985655 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:42.986655 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:42.986658 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:42.987094 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:42.987094 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:42.987219 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:42.987639 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:42.987648 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:42.989050 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:42.990525 (+ 1475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:42.990532 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:42.990534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:42.990750 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:42.990924 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:42.990924 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:42.990925 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:42.991023 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:42.991246 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:42.991253 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:42.991384 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 17:44:42.991472 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 17:44:42.991622 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":106,"threads_started":1}
I20260808 17:44:42.992250 5771 heartbeater.cc:347] Connected to a master server at 127.9.187.254:36293
I20260808 17:44:42.992355 5771 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:42.992534 5771 heartbeater.cc:511] Master 127.9.187.254:36293 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
I20260808 17:44:42.993032 5460 ts_manager.cc:194] Registered new tserver with Master: 9fa6026398864f8e8b3e28dd530a3507 (127.9.187.193:33085)
I20260808 17:44:42.993726 5460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:60867
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:44:43.008265 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36293
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:43.087226 5780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:43.087409 5780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:43.087430 5780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:43.088483 5780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:43.088516 5780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:43.088541 5780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:44:43.089895 5780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:43.090076 5780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:43.090296 5780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:43.094825 5787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:43.094885 5791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:43.094821 5793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:43.095166 5780 server_base.cc:1034] running on GCE node
I20260808 17:44:43.095341 5780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:43.095531 5780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:43.096676 5780 hybrid_clock.cc:648] HybridClock initialized: now 1786211083096661 us; error 31 us; skew 500 ppm
Aug 08 17:44:43 dist-test-slave-bqcl krb5kdc[5385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211083, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:43.099042 5780 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:44:43.099452 5780 webserver.cc:460] Webserver started at http://127.9.187.194:37051/ using document root <none> and password file <none>
I20260808 17:44:43.099665 5780 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:43.099715 5780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:43.099839 5780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:43.100808 5780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "cf1252a70f9d42c4aef288e5ade78028"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "97266011b2323e29d2793bddc43e2c1c"
server_key_iv: "0f5cc3ba33ead629d6dd795e4ef5af91"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.101120 5780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "cf1252a70f9d42c4aef288e5ade78028"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "97266011b2323e29d2793bddc43e2c1c"
server_key_iv: "0f5cc3ba33ead629d6dd795e4ef5af91"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.102334 5780 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:44:43.102973 5805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.103112 5780 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:43.103193 5780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "cf1252a70f9d42c4aef288e5ade78028"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "97266011b2323e29d2793bddc43e2c1c"
server_key_iv: "0f5cc3ba33ead629d6dd795e4ef5af91"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.103250 5780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:43.114177 5780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:43.115747 5780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:43.115873 5780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:43.116058 5780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:43.116331 5780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:43.116364 5780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.116391 5780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:43.116416 5780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.121981 5780 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:36425
I20260808 17:44:43.122078 5981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:36425 every 8 connection(s)
I20260808 17:44:43.122386 5780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:44:43 dist-test-slave-bqcl krb5kdc[5385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211083, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:43.130254 5538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.123004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:60135 (local address 127.9.187.254:36293)
0808 17:44:43.123048 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.123050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.123231 (+ 181us) server_negotiation.cc:407] Connection header received
0808 17:44:43.124081 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.124082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.124091 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.124142 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:43.124660 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.125144 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.126055 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.126291 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.126339 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.128146 (+ 1807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:43.128147 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:43.128148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:43.128154 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:43.129222 (+ 1068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:43.129550 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:43.129551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:43.129551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:43.129594 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:43.129762 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:43.129763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:43.129763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:43.129854 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:43.129899 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.130082 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.130189 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:44:43.130380 5987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.122979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:36293 (local address 127.9.187.194:60135)
0808 17:44:43.123127 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.123165 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.124002 (+ 837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.124193 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.124196 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.124423 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:43.124599 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.124604 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.125201 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.125201 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.125999 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.126001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.126349 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.126350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.126449 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.126821 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:43.126829 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:43.128057 (+ 1228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:43.129291 (+ 1234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:43.129297 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:43.129299 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:43.129496 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:43.129633 (+ 137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:43.129634 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:43.129634 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:43.129722 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:43.129896 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:43.129898 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:43.129996 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.130067 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.130214 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260808 17:44:43.130813 5983 heartbeater.cc:347] Connected to a master server at 127.9.187.254:36293
I20260808 17:44:43.130899 5983 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:43.131057 5983 heartbeater.cc:511] Master 127.9.187.254:36293 requested a full tablet report, sending...
I20260808 17:44:43.131394 5460 ts_manager.cc:194] Registered new tserver with Master: cf1252a70f9d42c4aef288e5ade78028 (127.9.187.194:36425)
I20260808 17:44:43.131747 5460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:60135
I20260808 17:44:43.132592 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 5780
I20260808 17:44:43.132696 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:44:43.132861 9967 external_mini_cluster.cc:1428] Setting key bd0c4a3b98181403f85311f7ee140636
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:44:43.156587 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36293
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:43.236555 5994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:43.236752 5994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:43.236773 5994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:43.237923 5994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:43.237963 5994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:43.237989 5994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:44:43.239410 5994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:43.239622 5994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:43.239823 5994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:43.244508 6002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:43.244503 6000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:43.244632 5994 server_base.cc:1034] running on GCE node
W20260808 17:44:43.244576 5999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:43.244969 5994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:43.245213 5994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:43.246373 5994 hybrid_clock.cc:648] HybridClock initialized: now 1786211083246358 us; error 25 us; skew 500 ppm
Aug 08 17:44:43 dist-test-slave-bqcl krb5kdc[5385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211083, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:43.248879 5994 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:44:43.249311 5994 webserver.cc:460] Webserver started at http://127.9.187.195:39793/ using document root <none> and password file <none>
I20260808 17:44:43.249505 5994 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:43.249552 5994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:43.249677 5994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:43.250753 5994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "af6d86b16299419ba82413cdbe0aadff"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "beb4644588c2507b3943413302264496"
server_key_iv: "3b47dd111763476e33ac16d580bfb0be"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.251080 5994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "af6d86b16299419ba82413cdbe0aadff"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "beb4644588c2507b3943413302264496"
server_key_iv: "3b47dd111763476e33ac16d580bfb0be"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.252274 5994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:44:43.252910 6014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.253074 5994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:43.253168 5994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "af6d86b16299419ba82413cdbe0aadff"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "beb4644588c2507b3943413302264496"
server_key_iv: "3b47dd111763476e33ac16d580bfb0be"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.253242 5994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:43.263480 5994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:43.265516 5994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:43.265645 5994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:43.265846 5994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:43.266144 5994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:43.266188 5994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.266233 5994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:43.266258 5994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.271710 5994 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:37429
I20260808 17:44:43.271775 6211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:37429 every 8 connection(s)
I20260808 17:44:43.272040 5994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:44:43 dist-test-slave-bqcl krb5kdc[5385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211083, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:43.280100 5538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.272680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:43229 (local address 127.9.187.254:36293)
0808 17:44:43.272743 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.272746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.272949 (+ 203us) server_negotiation.cc:407] Connection header received
0808 17:44:43.273429 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.273430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.273442 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.273501 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:43.274419 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.274908 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.275831 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.276030 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.276099 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.278013 (+ 1914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:43.278014 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:43.278014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:43.278021 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:43.279111 (+ 1090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:43.279438 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:43.279439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:43.279439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:43.279482 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:43.279647 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:43.279647 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:43.279647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:43.279740 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:43.279784 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.279972 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.280026 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 17:44:43.280251 6216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.272675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:36293 (local address 127.9.187.195:43229)
0808 17:44:43.272832 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.272868 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.273323 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.273554 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.273558 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.274098 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:43.274350 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.274356 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.274971 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.274971 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.275742 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.275744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.276098 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.276099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.276191 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.276650 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:43.276658 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:43.277935 (+ 1277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:43.279173 (+ 1238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:43.279178 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:43.279180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:43.279385 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:43.279523 (+ 138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:43.279523 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:43.279524 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:43.279607 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:43.279779 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:43.279781 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:43.279882 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.279954 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.280065 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260808 17:44:43.280697 6213 heartbeater.cc:347] Connected to a master server at 127.9.187.254:36293
I20260808 17:44:43.280791 6213 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:43.280965 6213 heartbeater.cc:511] Master 127.9.187.254:36293 requested a full tablet report, sending...
I20260808 17:44:43.281174 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 5994
I20260808 17:44:43.281281 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:44:43.281350 5460 ts_manager.cc:194] Registered new tserver with Master: af6d86b16299419ba82413cdbe0aadff (127.9.187.195:37429)
I20260808 17:44:43.281481 9967 external_mini_cluster.cc:1428] Setting key 949e4e6fa2e87a5113696b19280c6ebc
I20260808 17:44:43.281749 5460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:43229
I20260808 17:44:43.282356 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:44:43.288746 5538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.283595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60140 (local address 127.9.187.254:36293)
0808 17:44:43.283637 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.283639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.283771 (+ 132us) server_negotiation.cc:407] Connection header received
0808 17:44:43.283807 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.283808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.283816 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.283858 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:43.284351 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.284794 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.285507 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.285692 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.285744 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.286808 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:43.286809 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:43.286809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:43.286815 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:43.287908 (+ 1093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:43.288188 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:43.288189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:43.288189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:43.288234 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:43.288358 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:43.288359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:43.288359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:43.288483 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:43.288553 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.288624 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.288680 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:44:43.290093 5460 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:44:43.291695 5460 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:44:43.297768 6225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.293913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48324 (local address 127.9.187.194:36425)
0808 17:44:43.294095 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.294100 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.294167 (+ 67us) server_negotiation.cc:407] Connection header received
0808 17:44:43.294273 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.294275 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.294292 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.294363 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:43.294537 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.295296 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.296581 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.297351 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.297422 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.297484 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.297647 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.297685 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":75,"threads_started":1}
I20260808 17:44:43.297799 6222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.293714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:36425 (local address 127.0.0.1:48324)
0808 17:44:43.294094 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.294103 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.294168 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.294367 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.294369 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.294371 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:43.294454 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.294456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.295385 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.295386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.296492 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.296495 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.297434 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.297435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.297522 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.297538 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.297631 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.297689 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"mutex_wait_us":2,"thread_start_us":90,"threads_started":1}
I20260808 17:44:43.298360 6224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.293713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:33085 (local address 127.0.0.1:48928)
0808 17:44:43.293901 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.293941 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.294005 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.294509 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.294509 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.294512 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:43.294577 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.294578 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.295863 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.295865 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.296940 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.296943 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.297728 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.297729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.297791 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.297794 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.298245 (+ 451us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.298290 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":3,"thread_start_us":69,"threads_started":1}
I20260808 17:44:43.298727 5879 tablet_service.cc:1467] Processing CreateTablet for tablet d6bb37584f964247baed4c2cadc050ca (DEFAULT_TABLE table=test-table [id=cd889d2d216e4542853280172ba479f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:43.299027 6227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.293922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48928 (local address 127.9.187.193:33085)
0808 17:44:43.294276 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.294280 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.294289 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:44:43.294328 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.294330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.294352 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.294431 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:43.294657 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.295761 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.297008 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.297530 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.297599 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.297662 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.298621 (+ 959us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.298670 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":86,"threads_started":1}
I20260808 17:44:43.299050 6223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.293744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:37429 (local address 127.0.0.1:37770)
0808 17:44:43.294215 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.294224 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.294275 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.294509 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.294510 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.294514 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:43.294577 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.294578 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.297025 (+ 2447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.297026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.297972 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.297975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.298838 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.298839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.298897 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.298901 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.298950 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.298989 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"mutex_wait_us":6,"thread_start_us":86,"threads_started":1}
I20260808 17:44:43.299093 5879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6bb37584f964247baed4c2cadc050ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:43.299268 6230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.294030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37770 (local address 127.9.187.195:37429)
0808 17:44:43.294211 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.294216 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.294267 (+ 51us) server_negotiation.cc:407] Connection header received
0808 17:44:43.294346 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.294348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.294361 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.294431 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:43.294657 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.295764 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.298055 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.298750 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.298817 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.298873 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.299143 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.299184 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":119,"threads_started":1}
I20260808 17:44:43.299818 6092 tablet_service.cc:1467] Processing CreateTablet for tablet d6bb37584f964247baed4c2cadc050ca (DEFAULT_TABLE table=test-table [id=cd889d2d216e4542853280172ba479f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:43.299877 5655 tablet_service.cc:1467] Processing CreateTablet for tablet d6bb37584f964247baed4c2cadc050ca (DEFAULT_TABLE table=test-table [id=cd889d2d216e4542853280172ba479f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:43.300058 6092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6bb37584f964247baed4c2cadc050ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:43.300213 5655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6bb37584f964247baed4c2cadc050ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:43.302742 6233 tablet_bootstrap.cc:492] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff: Bootstrap starting.
I20260808 17:44:43.303350 6233 tablet_bootstrap.cc:654] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:43.303382 6237 tablet_bootstrap.cc:492] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507: Bootstrap starting.
I20260808 17:44:43.303948 6233 log.cc:824] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:43.304054 6237 tablet_bootstrap.cc:654] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:43.304373 6231 tablet_bootstrap.cc:492] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028: Bootstrap starting.
I20260808 17:44:43.304613 6237 log.cc:824] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:43.304780 6233 tablet_bootstrap.cc:492] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff: No bootstrap required, opened a new log
I20260808 17:44:43.304847 6233 ts_tablet_manager.cc:1397] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:43.304988 6231 tablet_bootstrap.cc:654] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:43.305449 6231 log.cc:824] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:43.306285 6231 tablet_bootstrap.cc:492] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028: No bootstrap required, opened a new log
I20260808 17:44:43.306321 6237 tablet_bootstrap.cc:492] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507: No bootstrap required, opened a new log
I20260808 17:44:43.306354 6231 ts_tablet_manager.cc:1397] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:43.306365 6237 ts_tablet_manager.cc:1397] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 17:44:43.306684 6233 raft_consensus.cc:348] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa6026398864f8e8b3e28dd530a3507" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33085 } } peers { permanent_uuid: "cf1252a70f9d42c4aef288e5ade78028" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36425 } } peers { permanent_uuid: "af6d86b16299419ba82413cdbe0aadff" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37429 } }
I20260808 17:44:43.306849 6233 raft_consensus.cc:374] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:43.306880 6233 raft_consensus.cc:729] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6d86b16299419ba82413cdbe0aadff, State: Initialized, Role: FOLLOWER
I20260808 17:44:43.306988 6233 consensus_queue.cc:260] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa6026398864f8e8b3e28dd530a3507" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33085 } } peers { permanent_uuid: "cf1252a70f9d42c4aef288e5ade78028" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36425 } } peers { permanent_uuid: "af6d86b16299419ba82413cdbe0aadff" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37429 } }
I20260808 17:44:43.307271 6233 ts_tablet_manager.cc:1428] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:44:43.307293 6213 heartbeater.cc:503] Master 127.9.187.254:36293 was elected leader, sending a full tablet report...
I20260808 17:44:43.307937 6237 raft_consensus.cc:348] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa6026398864f8e8b3e28dd530a3507" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33085 } } peers { permanent_uuid: "cf1252a70f9d42c4aef288e5ade78028" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36425 } } peers { permanent_uuid: "af6d86b16299419ba82413cdbe0aadff" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37429 } }
I20260808 17:44:43.308071 6237 raft_consensus.cc:374] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:43.308109 6237 raft_consensus.cc:729] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa6026398864f8e8b3e28dd530a3507, State: Initialized, Role: FOLLOWER
I20260808 17:44:43.308218 6237 consensus_queue.cc:260] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa6026398864f8e8b3e28dd530a3507" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33085 } } peers { permanent_uuid: "cf1252a70f9d42c4aef288e5ade78028" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36425 } } peers { permanent_uuid: "af6d86b16299419ba82413cdbe0aadff" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37429 } }
I20260808 17:44:43.308166 6231 raft_consensus.cc:348] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa6026398864f8e8b3e28dd530a3507" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33085 } } peers { permanent_uuid: "cf1252a70f9d42c4aef288e5ade78028" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36425 } } peers { permanent_uuid: "af6d86b16299419ba82413cdbe0aadff" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37429 } }
I20260808 17:44:43.308329 6231 raft_consensus.cc:374] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:43.308364 6231 raft_consensus.cc:729] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf1252a70f9d42c4aef288e5ade78028, State: Initialized, Role: FOLLOWER
I20260808 17:44:43.308498 6237 ts_tablet_manager.cc:1428] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:43.308632 5771 heartbeater.cc:503] Master 127.9.187.254:36293 was elected leader, sending a full tablet report...
I20260808 17:44:43.308604 6231 consensus_queue.cc:260] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa6026398864f8e8b3e28dd530a3507" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33085 } } peers { permanent_uuid: "cf1252a70f9d42c4aef288e5ade78028" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36425 } } peers { permanent_uuid: "af6d86b16299419ba82413cdbe0aadff" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37429 } }
I20260808 17:44:43.308849 6231 ts_tablet_manager.cc:1428] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:43.308876 5983 heartbeater.cc:503] Master 127.9.187.254:36293 was elected leader, sending a full tablet report...
I20260808 17:44:43.322854 6242 raft_consensus.cc:482] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:43.322964 6242 raft_consensus.cc:504] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa6026398864f8e8b3e28dd530a3507" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33085 } } peers { permanent_uuid: "cf1252a70f9d42c4aef288e5ade78028" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36425 } } peers { permanent_uuid: "af6d86b16299419ba82413cdbe0aadff" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37429 } }
I20260808 17:44:43.323238 6242 leader_election.cc:288] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa6026398864f8e8b3e28dd530a3507 (127.9.187.193:33085), cf1252a70f9d42c4aef288e5ade78028 (127.9.187.194:36425)
I20260808 17:44:43.326895 6225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.323477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:59307 (local address 127.9.187.194:36425)
0808 17:44:43.323526 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.323528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.323541 (+ 13us) server_negotiation.cc:407] Connection header received
0808 17:44:43.323568 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.323569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.323589 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.323661 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:43.323802 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.324560 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.325915 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.326535 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.326618 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.326628 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.326782 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.326822 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:44:43.326895 6227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.323492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:45007 (local address 127.9.187.193:33085)
0808 17:44:43.323528 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.323530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.323729 (+ 199us) server_negotiation.cc:407] Connection header received
0808 17:44:43.323757 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.323758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.323768 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.323830 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:43.323936 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.324621 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.325916 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.326540 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.326618 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.326628 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.326783 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.326822 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:44:43.326930 6216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.323403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:36425 (local address 127.9.187.195:59307)
0808 17:44:43.323455 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.323466 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.323504 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.323667 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.323668 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.323671 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:43.323739 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.323742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.324634 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.324635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.325833 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.325836 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.326615 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.326616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.326711 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.326713 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.326767 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.326818 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":7}
I20260808 17:44:43.326936 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.323452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:33085 (local address 127.9.187.195:45007)
0808 17:44:43.323647 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.323657 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.323712 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.323835 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.323835 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.323836 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:43.323883 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.323884 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.324683 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.324684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.325833 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.325836 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.326626 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.326627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.326707 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.326711 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.326767 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.326817 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":8,"thread_start_us":141,"threads_started":1}
I20260808 17:44:43.327346 5912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6bb37584f964247baed4c2cadc050ca" candidate_uuid: "af6d86b16299419ba82413cdbe0aadff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf1252a70f9d42c4aef288e5ade78028" is_pre_election: true
I20260808 17:44:43.327471 5912 raft_consensus.cc:2454] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6d86b16299419ba82413cdbe0aadff in term 0.
I20260808 17:44:43.327705 6017 leader_election.cc:302] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6d86b16299419ba82413cdbe0aadff, cf1252a70f9d42c4aef288e5ade78028; no voters:
I20260808 17:44:43.327804 5700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6bb37584f964247baed4c2cadc050ca" candidate_uuid: "af6d86b16299419ba82413cdbe0aadff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa6026398864f8e8b3e28dd530a3507" is_pre_election: true
I20260808 17:44:43.327852 6242 raft_consensus.cc:2781] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:44:43.327914 6242 raft_consensus.cc:482] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:44:43.327944 6242 raft_consensus.cc:3037] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:43.327946 5700 raft_consensus.cc:2454] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6d86b16299419ba82413cdbe0aadff in term 0.
I20260808 17:44:43.328639 6242 raft_consensus.cc:504] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa6026398864f8e8b3e28dd530a3507" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33085 } } peers { permanent_uuid: "cf1252a70f9d42c4aef288e5ade78028" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36425 } } peers { permanent_uuid: "af6d86b16299419ba82413cdbe0aadff" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37429 } }
I20260808 17:44:43.328763 6242 leader_election.cc:288] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [CANDIDATE]: Term 1 election: Requested vote from peers 9fa6026398864f8e8b3e28dd530a3507 (127.9.187.193:33085), cf1252a70f9d42c4aef288e5ade78028 (127.9.187.194:36425)
I20260808 17:44:43.328923 5700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6bb37584f964247baed4c2cadc050ca" candidate_uuid: "af6d86b16299419ba82413cdbe0aadff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa6026398864f8e8b3e28dd530a3507"
I20260808 17:44:43.329015 5700 raft_consensus.cc:3037] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:43.329005 5912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6bb37584f964247baed4c2cadc050ca" candidate_uuid: "af6d86b16299419ba82413cdbe0aadff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf1252a70f9d42c4aef288e5ade78028"
I20260808 17:44:43.329082 5912 raft_consensus.cc:3037] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:43.329973 5700 raft_consensus.cc:2454] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6d86b16299419ba82413cdbe0aadff in term 1.
I20260808 17:44:43.329973 5912 raft_consensus.cc:2454] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6d86b16299419ba82413cdbe0aadff in term 1.
I20260808 17:44:43.330188 6015 leader_election.cc:302] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fa6026398864f8e8b3e28dd530a3507, af6d86b16299419ba82413cdbe0aadff; no voters:
I20260808 17:44:43.330297 6242 raft_consensus.cc:2781] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:43.330432 6242 raft_consensus.cc:686] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 1 LEADER]: Becoming Leader. State: Replica: af6d86b16299419ba82413cdbe0aadff, State: Running, Role: LEADER
I20260808 17:44:43.330519 6242 consensus_queue.cc:237] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa6026398864f8e8b3e28dd530a3507" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33085 } } peers { permanent_uuid: "cf1252a70f9d42c4aef288e5ade78028" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36425 } } peers { permanent_uuid: "af6d86b16299419ba82413cdbe0aadff" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37429 } }
I20260808 17:44:43.331275 5460 catalog_manager.cc:5495] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff reported cstate change: term changed from 0 to 1, leader changed from <none> to af6d86b16299419ba82413cdbe0aadff (127.9.187.195). New cstate: current_term: 1 leader_uuid: "af6d86b16299419ba82413cdbe0aadff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa6026398864f8e8b3e28dd530a3507" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf1252a70f9d42c4aef288e5ade78028" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6d86b16299419ba82413cdbe0aadff" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37429 } health_report { overall_health: HEALTHY } } }
I20260808 17:44:43.342972 6230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.340849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37784 (local address 127.9.187.195:37429)
0808 17:44:43.340894 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.340896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.340904 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:43.340961 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.340961 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.340976 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.341034 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:44:43.341130 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.341570 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.342296 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.342482 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.342531 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.342706 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:44:43.342796 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:44:43.342853 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.342868 (+ 15us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.342886 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:44:43.344633 5912 raft_consensus.cc:1261] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028 [term 1 FOLLOWER]: Refusing update from remote peer af6d86b16299419ba82413cdbe0aadff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:43.344651 5700 raft_consensus.cc:1261] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507 [term 1 FOLLOWER]: Refusing update from remote peer af6d86b16299419ba82413cdbe0aadff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:43.344990 6242 consensus_queue.cc:1035] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf1252a70f9d42c4aef288e5ade78028" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 36425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:43.345127 6247 consensus_queue.cc:1035] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa6026398864f8e8b3e28dd530a3507" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:43.347298 6252 mvcc.cc:205] Tried to move back new op lower bound from 7316320597377331200 to 7316320597322526720. Current Snapshot: MvccSnapshot[applied={T|T < 7316320597377331200}]
I20260808 17:44:43.347741 6254 mvcc.cc:205] Tried to move back new op lower bound from 7316320597377331200 to 7316320597322526720. Current Snapshot: MvccSnapshot[applied={T|T < 7316320597377331200}]
I20260808 17:44:43.348647 6255 mvcc.cc:205] Tried to move back new op lower bound from 7316320597377331200 to 7316320597322526720. Current Snapshot: MvccSnapshot[applied={T|T < 7316320597377331200 or (T in {7316320597377331200})}]
I20260808 17:44:43.349740 5459 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:43.349835 5459 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:43.350575 5459 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e7abfbb73c747e5abe0fa944f85d054: Sending DeleteTablet for 3 replicas of tablet d6bb37584f964247baed4c2cadc050ca
I20260808 17:44:43.350881 5655 tablet_service.cc:1514] Processing DeleteTablet for tablet d6bb37584f964247baed4c2cadc050ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:43 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:48928
I20260808 17:44:43.350961 6092 tablet_service.cc:1514] Processing DeleteTablet for tablet d6bb37584f964247baed4c2cadc050ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:43 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:37770
I20260808 17:44:43.351145 6272 tablet_replica.cc:330] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507: stopping tablet replica
I20260808 17:44:43.351192 5879 tablet_service.cc:1514] Processing DeleteTablet for tablet d6bb37584f964247baed4c2cadc050ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:43 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:48324
I20260808 17:44:43.351238 6272 raft_consensus.cc:2229] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:43.351332 6272 raft_consensus.cc:2258] T d6bb37584f964247baed4c2cadc050ca P 9fa6026398864f8e8b3e28dd530a3507 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:43.351540 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 5564
I20260808 17:44:43.358999 6273 tablet_replica.cc:330] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff: stopping tablet replica
I20260808 17:44:43.359167 6273 raft_consensus.cc:2229] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:44:43.359309 6273 raft_consensus.cc:2258] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:43.360749 6273 ts_tablet_manager.cc:1905] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:43.362455 6274 tablet_replica.cc:330] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028: stopping tablet replica
I20260808 17:44:43.362622 6274 raft_consensus.cc:2229] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:43.362785 6274 raft_consensus.cc:2258] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:43.363122 6273 ts_tablet_manager.cc:1918] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:43.363215 6273 log.cc:1196] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/d6bb37584f964247baed4c2cadc050ca
I20260808 17:44:43.363474 6273 ts_tablet_manager.cc:1939] T d6bb37584f964247baed4c2cadc050ca P af6d86b16299419ba82413cdbe0aadff: Deleting consensus metadata
I20260808 17:44:43.363560 6274 ts_tablet_manager.cc:1905] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:43.363909 5437 catalog_manager.cc:4841] TS af6d86b16299419ba82413cdbe0aadff (127.9.187.195:37429): tablet d6bb37584f964247baed4c2cadc050ca (table test-table [id=cd889d2d216e4542853280172ba479f2]) successfully deleted
I20260808 17:44:43.364832 6274 ts_tablet_manager.cc:1918] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:43.364898 6274 log.cc:1196] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/d6bb37584f964247baed4c2cadc050ca
I20260808 17:44:43.365139 6274 ts_tablet_manager.cc:1939] T d6bb37584f964247baed4c2cadc050ca P cf1252a70f9d42c4aef288e5ade78028: Deleting consensus metadata
W20260808 17:44:43.365458 5434 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:33085 (error 108)
I20260808 17:44:43.365512 5436 catalog_manager.cc:4841] TS cf1252a70f9d42c4aef288e5ade78028 (127.9.187.194:36425): tablet d6bb37584f964247baed4c2cadc050ca (table test-table [id=cd889d2d216e4542853280172ba479f2]) successfully deleted
I20260808 17:44:43.365955 6223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.365835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:33085 (local address 127.0.0.1:48930)
0808 17:44:43.365887 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.365926 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:33085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 17:44:43.366034 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 5780
W20260808 17:44:43.366103 5434 catalog_manager.cc:4584] TS 9fa6026398864f8e8b3e28dd530a3507 (127.9.187.193:33085): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d6bb37584f964247baed4c2cadc050ca: Network error: Client connection negotiation failed: client connection to 127.9.187.193:33085: connect: Connection refused (error 111)
I20260808 17:44:43.378638 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 5994
I20260808 17:44:43.388003 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 5412
2026-08-08T17:44:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2018 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T17:44:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:43Z Disabled control of system clock
I20260808 17:44:43.422173 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:36439
--webserver_interface=127.9.187.254
--webserver_port=0
--builtin_ntp_servers=127.9.187.212:35903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:36439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:44:43.502471 6281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:43.502679 6281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:43.502699 6281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:43.503818 6281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:43.503859 6281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:43.503870 6281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:43.503882 6281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:43.503892 6281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:43.505221 6281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:36439
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:36439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:43.505460 6281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:43.505751 6281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:43.510319 6292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:43.510326 6296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:43.510339 6291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:43.510427 6281 server_base.cc:1034] running on GCE node
I20260808 17:44:43.510748 6281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:43.511010 6281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:43.512140 6281 hybrid_clock.cc:648] HybridClock initialized: now 1786211083512128 us; error 30 us; skew 500 ppm
I20260808 17:44:43.513269 6281 webserver.cc:460] Webserver started at http://127.9.187.254:40857/ using document root <none> and password file <none>
I20260808 17:44:43.513481 6281 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:43.513530 6281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:43.513648 6281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:43.514680 6281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "bf855ca08bff45a793fe3ef06d07520b"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "b661cd92b179f8605ed265f337eaf493"
server_key_iv: "35d32b9fb1d057cdd9f268ecf24b5e98"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.514997 6281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "bf855ca08bff45a793fe3ef06d07520b"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "b661cd92b179f8605ed265f337eaf493"
server_key_iv: "35d32b9fb1d057cdd9f268ecf24b5e98"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.516165 6281 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:44:43.516762 6306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.517009 6281 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:43.517086 6281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "bf855ca08bff45a793fe3ef06d07520b"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "b661cd92b179f8605ed265f337eaf493"
server_key_iv: "35d32b9fb1d057cdd9f268ecf24b5e98"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.517138 6281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:43.526309 6281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:43.526535 6281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:43.526628 6281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:43.530172 6281 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:36439
I20260808 17:44:43.530203 6385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:36439 every 8 connection(s)
I20260808 17:44:43.530499 6281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:43.531410 6386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:43.533478 6386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b: Bootstrap starting.
I20260808 17:44:43.533965 6386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:43.534260 6386 log.cc:824] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:43.534888 6386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b: No bootstrap required, opened a new log
I20260808 17:44:43.536222 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 6281
I20260808 17:44:43.536321 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:43.536512 9967 external_mini_cluster.cc:1428] Setting key 9c4be7b89b53d24a74f84fd91dc0deb9
I20260808 17:44:43.536610 6386 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf855ca08bff45a793fe3ef06d07520b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36439 } }
I20260808 17:44:43.536906 6386 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:43.536963 6386 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf855ca08bff45a793fe3ef06d07520b, State: Initialized, Role: FOLLOWER
I20260808 17:44:43.537111 6386 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf855ca08bff45a793fe3ef06d07520b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36439 } }
I20260808 17:44:43.537202 6386 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:43.537240 6386 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:43.537277 6386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:43.537771 6386 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf855ca08bff45a793fe3ef06d07520b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36439 } }
I20260808 17:44:43.537866 6386 leader_election.cc:302] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf855ca08bff45a793fe3ef06d07520b; no voters:
I20260808 17:44:43.538013 6386 leader_election.cc:288] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:43.538055 6393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:43.538204 6393 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [term 1 LEADER]: Becoming Leader. State: Replica: bf855ca08bff45a793fe3ef06d07520b, State: Running, Role: LEADER
I20260808 17:44:43.538296 6386 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:43.538307 6393 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf855ca08bff45a793fe3ef06d07520b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36439 } }
I20260808 17:44:43.538940 6394 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf855ca08bff45a793fe3ef06d07520b. Latest consensus state: current_term: 1 leader_uuid: "bf855ca08bff45a793fe3ef06d07520b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf855ca08bff45a793fe3ef06d07520b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36439 } } }
I20260808 17:44:43.539040 6394 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:43.538950 6397 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf855ca08bff45a793fe3ef06d07520b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf855ca08bff45a793fe3ef06d07520b" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 36439 } } }
I20260808 17:44:43.539259 6397 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:43.539389 6407 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:43.539839 6407 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:43.542251 6407 catalog_manager.cc:1347] Generated new cluster ID: 9cf2e4ae799c42d3b69ea8b83929b76c
I20260808 17:44:43.542361 6407 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:43.542906 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.537008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39426 (local address 127.9.187.254:36439)
0808 17:44:43.537253 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.537262 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.537297 (+ 35us) server_negotiation.cc:407] Connection header received
0808 17:44:43.537402 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.537408 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.537458 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.537590 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:43.537817 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.539451 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.540535 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.541126 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.541249 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.541959 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:43.541963 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:43.541963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:43.542238 (+ 275us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:43.542288 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:43.542303 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:43.542383 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.542610 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.542701 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":110,"threads_started":1}
I20260808 17:44:43.572530 6407 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:43.573087 6407 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:43.577098 6407 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b: Generated new TSK 0
I20260808 17:44:43.577322 6407 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:44:43.581741 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36439
--builtin_ntp_servers=127.9.187.212:35903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:44:43.663821 6429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:43.664032 6429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:43.664053 6429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:43.665371 6429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:43.665431 6429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:43.665457 6429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:44:43.666983 6429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:43.667224 6429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:43.667523 6429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:43.672446 6439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:43.672500 6429 server_base.cc:1034] running on GCE node
W20260808 17:44:43.672441 6441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:43.672473 6437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:43.672845 6429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:43.673064 6429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:43.674199 6429 hybrid_clock.cc:648] HybridClock initialized: now 1786211083674171 us; error 29 us; skew 500 ppm
I20260808 17:44:43.675380 6429 webserver.cc:460] Webserver started at http://127.9.187.193:36247/ using document root <none> and password file <none>
I20260808 17:44:43.675591 6429 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:43.675640 6429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:43.675770 6429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:43.676776 6429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "a2651cd46b7c40ef89582b7a884e1ce2"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "a330cc1a98dbc021ad7056daceec9c41"
server_key_iv: "12318469420b637bae552c98179c2ffa"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.677100 6429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "a2651cd46b7c40ef89582b7a884e1ce2"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "a330cc1a98dbc021ad7056daceec9c41"
server_key_iv: "12318469420b637bae552c98179c2ffa"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.678341 6429 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:44:43.678951 6451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.679109 6429 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.679190 6429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "a2651cd46b7c40ef89582b7a884e1ce2"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "a330cc1a98dbc021ad7056daceec9c41"
server_key_iv: "12318469420b637bae552c98179c2ffa"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.679260 6429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:43.701066 6429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:43.701373 6429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:43.701510 6429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:43.701725 6429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:43.702032 6429 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:43.702067 6429 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.702096 6429 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:43.702113 6429 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.707598 6429 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:39413
I20260808 17:44:43.707664 6646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:39413 every 8 connection(s)
I20260808 17:44:43.707953 6429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:44:43.712826 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.708632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:48599 (local address 127.9.187.254:36439)
0808 17:44:43.708701 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.708704 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.708925 (+ 221us) server_negotiation.cc:407] Connection header received
0808 17:44:43.709379 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.709380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.709390 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.709449 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:43.710100 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.710658 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.711655 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.711847 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.711898 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.712609 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:43.712611 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:43.712611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:43.712615 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:43.712629 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:43.712633 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:43.712672 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.712738 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.712765 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 17:44:43.712996 6650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.708617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:36439 (local address 127.9.187.193:48599)
0808 17:44:43.708806 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.708847 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.709305 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.709520 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.709523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.709531 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:43.710019 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.710024 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.710741 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.710742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.711582 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.711586 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.711915 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.711916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.712027 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.712484 (+ 457us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:44:43.712484 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:43.712514 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:44:43.712536 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:43.712677 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:43.712680 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:43.712682 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.712733 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.712811 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":79,"threads_started":1}
I20260808 17:44:43.713462 6647 heartbeater.cc:347] Connected to a master server at 127.9.187.254:36439
I20260808 17:44:43.713546 6647 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:43.713724 6647 heartbeater.cc:511] Master 127.9.187.254:36439 requested a full tablet report, sending...
I20260808 17:44:43.714217 6332 ts_manager.cc:194] Registered new tserver with Master: a2651cd46b7c40ef89582b7a884e1ce2 (127.9.187.193:39413)
I20260808 17:44:43.714825 6332 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.193:48599
I20260808 17:44:43.717461 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 6429
I20260808 17:44:43.717550 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:44:43.717770 9967 external_mini_cluster.cc:1428] Setting key 891ae630b2f1ea0b875a7cf0e4c6b66b
I20260808 17:44:43.718647 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36439
--builtin_ntp_servers=127.9.187.212:35903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:44:43.799412 6651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:43.799606 6651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:43.799634 6651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:43.800719 6651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:43.800757 6651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:43.800789 6651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:44:43.802069 6651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:43.802330 6651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:43.802592 6651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:43.807370 6657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:43.807365 6658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:43.807365 6662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:43.807631 6651 server_base.cc:1034] running on GCE node
I20260808 17:44:43.807880 6651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:43.808086 6651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:43.809226 6651 hybrid_clock.cc:648] HybridClock initialized: now 1786211083809208 us; error 33 us; skew 500 ppm
I20260808 17:44:43.810415 6651 webserver.cc:460] Webserver started at http://127.9.187.194:36023/ using document root <none> and password file <none>
I20260808 17:44:43.810640 6651 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:43.810689 6651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:43.810814 6651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:43.811888 6651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "4a98474fe41744c09e68de1bbc1d30e6"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "cf6ec641a95150acb4461767bfdb72cd"
server_key_iv: "27c9101cd0a9b4d60dd806442074f5fb"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.812222 6651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "4a98474fe41744c09e68de1bbc1d30e6"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "cf6ec641a95150acb4461767bfdb72cd"
server_key_iv: "27c9101cd0a9b4d60dd806442074f5fb"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.813411 6651 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:44:43.814041 6672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.814213 6651 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:44:43.814292 6651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "4a98474fe41744c09e68de1bbc1d30e6"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "cf6ec641a95150acb4461767bfdb72cd"
server_key_iv: "27c9101cd0a9b4d60dd806442074f5fb"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.814350 6651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:43.828158 6651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:43.828401 6651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:43.828519 6651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:43.828699 6651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:43.828991 6651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:43.829026 6651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.829052 6651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:43.829070 6651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.834300 6651 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:37061
I20260808 17:44:43.834360 6852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:37061 every 8 connection(s)
I20260808 17:44:43.834627 6651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:44:43.839233 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.835236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:56295 (local address 127.9.187.254:36439)
0808 17:44:43.835299 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.835301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.835502 (+ 201us) server_negotiation.cc:407] Connection header received
0808 17:44:43.835950 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.835951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.835960 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.836009 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:43.836625 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.837108 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.838014 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.838243 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.838292 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.839031 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:43.839032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:43.839033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:43.839037 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:43.839053 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:43.839057 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:43.839096 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.839146 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.839170 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 17:44:43.839409 6855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.835222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:36439 (local address 127.9.187.194:56295)
0808 17:44:43.835395 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.835426 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.835872 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.836068 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.836072 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.836082 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:43.836548 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.836553 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.837176 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.837178 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.837954 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.837957 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.838301 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.838302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.838461 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.838911 (+ 450us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:44:43.838911 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:43.838937 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:44:43.838959 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:43.839097 (+ 138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:43.839099 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:43.839102 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.839142 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.839216 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":86,"threads_started":1}
I20260808 17:44:43.839818 6853 heartbeater.cc:347] Connected to a master server at 127.9.187.254:36439
I20260808 17:44:43.839901 6853 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:43.840065 6853 heartbeater.cc:511] Master 127.9.187.254:36439 requested a full tablet report, sending...
I20260808 17:44:43.840386 6332 ts_manager.cc:194] Registered new tserver with Master: 4a98474fe41744c09e68de1bbc1d30e6 (127.9.187.194:37061)
I20260808 17:44:43.840745 6332 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.194:56295
I20260808 17:44:43.843868 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 6651
I20260808 17:44:43.843956 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:44:43.844115 9967 external_mini_cluster.cc:1428] Setting key e544ec6b837b7a869e6c3d4d95f158e7
I20260808 17:44:43.844972 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36439
--builtin_ntp_servers=127.9.187.212:35903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:44:43.925881 6856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:43.926081 6856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:43.926103 6856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:43.927222 6856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:43.927261 6856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:43.927284 6856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:44:43.928558 6856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:36439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:43.928761 6856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:43.929025 6856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:43.933817 6862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:43.933871 6856 server_base.cc:1034] running on GCE node
W20260808 17:44:43.933845 6863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:43.933900 6868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:43.934252 6856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:43.934487 6856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:43.935621 6856 hybrid_clock.cc:648] HybridClock initialized: now 1786211083935612 us; error 33 us; skew 500 ppm
I20260808 17:44:43.936825 6856 webserver.cc:460] Webserver started at http://127.9.187.195:41171/ using document root <none> and password file <none>
I20260808 17:44:43.937032 6856 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:43.937077 6856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:43.937186 6856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:43.938275 6856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "c1ec33b6682b4b3a9876dff14a51a164"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "67b55c13e5767f7297be128a28d684f2"
server_key_iv: "b975d5553b224440dd6affde9f4e625b"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.938592 6856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "c1ec33b6682b4b3a9876dff14a51a164"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "67b55c13e5767f7297be128a28d684f2"
server_key_iv: "b975d5553b224440dd6affde9f4e625b"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.939836 6856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:44:43.940529 6883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.940675 6856 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:44:43.940762 6856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "c1ec33b6682b4b3a9876dff14a51a164"
format_stamp: "Formatted at 2026-08-08 17:44:43 on dist-test-slave-bqcl"
server_key: "67b55c13e5767f7297be128a28d684f2"
server_key_iv: "b975d5553b224440dd6affde9f4e625b"
server_key_version: "encryptionkey@0"
I20260808 17:44:43.940827 6856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:43.951330 6856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:43.951570 6856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:43.951690 6856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:43.951884 6856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:43.952169 6856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:43.952203 6856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.952229 6856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:43.952246 6856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:43.957417 6856 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:42811
I20260808 17:44:43.957470 7078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:42811 every 8 connection(s)
I20260808 17:44:43.957775 6856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:44:43.960300 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 6856
I20260808 17:44:43.960378 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:44:43.960553 9967 external_mini_cluster.cc:1428] Setting key 4d9f7639cf5c5558bd9438a002fcaed8
I20260808 17:44:43.962747 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.958476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:46155 (local address 127.9.187.254:36439)
0808 17:44:43.958540 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.958543 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.958785 (+ 242us) server_negotiation.cc:407] Connection header received
0808 17:44:43.959235 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.959237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.959247 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.959296 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:43.959915 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.960482 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.961445 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.961648 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.961701 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.962487 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:43.962488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:43.962489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:43.962493 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:43.962510 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:43.962514 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:43.962555 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.962635 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.962668 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:44:43.962929 7083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.958473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:36439 (local address 127.9.187.195:46155)
0808 17:44:43.958677 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.958710 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.959161 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.959351 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.959354 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.959362 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:43.959850 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.959854 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.960561 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.960562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.961364 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.961367 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.961720 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.961721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.961841 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.962355 (+ 514us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:44:43.962355 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:43.962383 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:44:43.962405 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:43.962571 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:43.962575 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:43.962578 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.962634 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.962743 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":91,"threads_started":1}
I20260808 17:44:43.963299 7081 heartbeater.cc:347] Connected to a master server at 127.9.187.254:36439
I20260808 17:44:43.963387 7081 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:43.963560 7081 heartbeater.cc:511] Master 127.9.187.254:36439 requested a full tablet report, sending...
I20260808 17:44:43.963893 6332 ts_manager.cc:194] Registered new tserver with Master: c1ec33b6682b4b3a9876dff14a51a164 (127.9.187.195:42811)
I20260808 17:44:43.964255 6332 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.195:46155
I20260808 17:44:43.972118 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:44:43.976143 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.973453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39428 (local address 127.9.187.254:36439)
0808 17:44:43.973518 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.973520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.973615 (+ 95us) server_negotiation.cc:407] Connection header received
0808 17:44:43.973678 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.973679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.973691 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.973737 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:43.973873 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.974390 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.975126 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.975308 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.975360 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.975905 (+ 545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:43.975907 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:43.975907 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:43.975912 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:43.975926 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:43.975930 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:43.975973 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.976048 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.976070 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:44:43.977409 6332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:44:43.978896 6332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:44:43.984712 7097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.980982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:42811 (local address 127.0.0.1:43282)
0808 17:44:43.981318 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.981326 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.981374 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.981511 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.981512 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.981514 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:43.981543 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.981544 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.982529 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.982530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.983686 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.983689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.984437 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.984438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.984514 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.984526 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.984588 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.984640 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":74,"threads_started":1}
I20260808 17:44:43.984725 7105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.981064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43282 (local address 127.9.187.195:42811)
0808 17:44:43.981225 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.981230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.981384 (+ 154us) server_negotiation.cc:407] Connection header received
0808 17:44:43.981422 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.981424 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.981437 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.981508 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:43.981616 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.982454 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.983787 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.984366 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.984429 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.984521 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.984601 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.984638 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":74,"threads_started":1}
I20260808 17:44:43.984920 7104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.980775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:39413 (local address 127.0.0.1:60406)
0808 17:44:43.981106 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.981145 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.981219 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.981491 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.981492 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.981494 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:43.981565 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.981567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.982951 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.982952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.983763 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.983765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.984693 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.984694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.984755 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.984759 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.984802 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.984842 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":12,"thread_start_us":57,"threads_started":1}
I20260808 17:44:43.985149 7103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.980871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60406 (local address 127.9.187.193:39413)
0808 17:44:43.981099 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.981104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.981298 (+ 194us) server_negotiation.cc:407] Connection header received
0808 17:44:43.981336 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.981338 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.981349 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.981423 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:43.981709 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.982871 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.983831 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.984499 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.984570 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.984656 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.985031 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.985075 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":111,"threads_started":1}
I20260808 17:44:43.985441 6966 tablet_service.cc:1467] Processing CreateTablet for tablet 73a81023437c47d6806e291a76fc7804 (DEFAULT_TABLE table=test-table [id=fc6848c8cd184bc0b3d9fdb203d52c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:43.985635 7096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.980777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:37061 (local address 127.0.0.1:47774)
0808 17:44:43.981154 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:43.981164 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:43.981228 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:43.981461 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:43.981464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:43.981467 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:43.981523 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.981525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.982915 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.982916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.983957 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:43.983960 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.985416 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.985417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:43.985466 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.985469 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:43.985532 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 17:44:43.985571 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":84,"threads_started":1}
I20260808 17:44:43.985669 7101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:43.980886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47774 (local address 127.9.187.194:37061)
0808 17:44:43.981247 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:43.981251 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:43.981262 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:44:43.981302 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:43.981304 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:43.981318 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:43.981391 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:43.981595 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.982840 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.984037 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:43.984743 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:43.985098 (+ 355us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:43.985196 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:43.985552 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 17:44:43.985593 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":83,"threads_started":1}
I20260808 17:44:43.985829 6966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73a81023437c47d6806e291a76fc7804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:43.985797 6535 tablet_service.cc:1467] Processing CreateTablet for tablet 73a81023437c47d6806e291a76fc7804 (DEFAULT_TABLE table=test-table [id=fc6848c8cd184bc0b3d9fdb203d52c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:43.986146 6535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73a81023437c47d6806e291a76fc7804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:43.986709 6753 tablet_service.cc:1467] Processing CreateTablet for tablet 73a81023437c47d6806e291a76fc7804 (DEFAULT_TABLE table=test-table [id=fc6848c8cd184bc0b3d9fdb203d52c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:43.987010 6753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73a81023437c47d6806e291a76fc7804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:43.989230 7108 tablet_bootstrap.cc:492] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2: Bootstrap starting.
I20260808 17:44:43.989530 7110 tablet_bootstrap.cc:492] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6: Bootstrap starting.
I20260808 17:44:43.989894 7108 tablet_bootstrap.cc:654] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:43.990176 7110 tablet_bootstrap.cc:654] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:43.990247 7108 log.cc:824] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:43.990513 7110 log.cc:824] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:43.990603 7107 tablet_bootstrap.cc:492] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164: Bootstrap starting.
I20260808 17:44:43.991171 7107 tablet_bootstrap.cc:654] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:43.991209 7110 tablet_bootstrap.cc:492] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6: No bootstrap required, opened a new log
I20260808 17:44:43.991264 7110 ts_tablet_manager.cc:1397] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:44:43.991483 7107 log.cc:824] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:43.992012 7108 tablet_bootstrap.cc:492] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2: No bootstrap required, opened a new log
I20260808 17:44:43.992089 7108 ts_tablet_manager.cc:1397] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 17:44:43.992216 7107 tablet_bootstrap.cc:492] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164: No bootstrap required, opened a new log
I20260808 17:44:43.992309 7107 ts_tablet_manager.cc:1397] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:43.993743 7110 raft_consensus.cc:348] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39413 } } peers { permanent_uuid: "c1ec33b6682b4b3a9876dff14a51a164" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42811 } } peers { permanent_uuid: "4a98474fe41744c09e68de1bbc1d30e6" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 37061 } }
I20260808 17:44:43.993913 7110 raft_consensus.cc:374] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:43.993948 7110 raft_consensus.cc:729] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a98474fe41744c09e68de1bbc1d30e6, State: Initialized, Role: FOLLOWER
I20260808 17:44:43.994081 7110 consensus_queue.cc:260] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39413 } } peers { permanent_uuid: "c1ec33b6682b4b3a9876dff14a51a164" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42811 } } peers { permanent_uuid: "4a98474fe41744c09e68de1bbc1d30e6" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 37061 } }
I20260808 17:44:43.994182 7107 raft_consensus.cc:348] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39413 } } peers { permanent_uuid: "c1ec33b6682b4b3a9876dff14a51a164" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42811 } } peers { permanent_uuid: "4a98474fe41744c09e68de1bbc1d30e6" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 37061 } }
I20260808 17:44:43.994342 7107 raft_consensus.cc:374] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:43.994359 7110 ts_tablet_manager.cc:1428] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:44:43.994382 7107 raft_consensus.cc:729] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1ec33b6682b4b3a9876dff14a51a164, State: Initialized, Role: FOLLOWER
I20260808 17:44:43.994478 6853 heartbeater.cc:503] Master 127.9.187.254:36439 was elected leader, sending a full tablet report...
I20260808 17:44:43.994503 7107 consensus_queue.cc:260] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39413 } } peers { permanent_uuid: "c1ec33b6682b4b3a9876dff14a51a164" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42811 } } peers { permanent_uuid: "4a98474fe41744c09e68de1bbc1d30e6" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 37061 } }
I20260808 17:44:43.994478 7108 raft_consensus.cc:348] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39413 } } peers { permanent_uuid: "c1ec33b6682b4b3a9876dff14a51a164" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42811 } } peers { permanent_uuid: "4a98474fe41744c09e68de1bbc1d30e6" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 37061 } }
I20260808 17:44:43.994614 7108 raft_consensus.cc:374] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:43.994654 7108 raft_consensus.cc:729] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2651cd46b7c40ef89582b7a884e1ce2, State: Initialized, Role: FOLLOWER
I20260808 17:44:43.994746 7107 ts_tablet_manager.cc:1428] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:43.994794 7108 consensus_queue.cc:260] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39413 } } peers { permanent_uuid: "c1ec33b6682b4b3a9876dff14a51a164" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42811 } } peers { permanent_uuid: "4a98474fe41744c09e68de1bbc1d30e6" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 37061 } }
I20260808 17:44:43.994853 7081 heartbeater.cc:503] Master 127.9.187.254:36439 was elected leader, sending a full tablet report...
I20260808 17:44:43.995047 7108 ts_tablet_manager.cc:1428] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:44:43.995131 6647 heartbeater.cc:503] Master 127.9.187.254:36439 was elected leader, sending a full tablet report...
I20260808 17:44:44.053081 7117 raft_consensus.cc:482] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:44.053224 7117 raft_consensus.cc:504] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39413 } } peers { permanent_uuid: "c1ec33b6682b4b3a9876dff14a51a164" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42811 } } peers { permanent_uuid: "4a98474fe41744c09e68de1bbc1d30e6" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 37061 } }
I20260808 17:44:44.053627 7117 leader_election.cc:288] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1ec33b6682b4b3a9876dff14a51a164 (127.9.187.195:42811), 4a98474fe41744c09e68de1bbc1d30e6 (127.9.187.194:37061)
I20260808 17:44:44.056370 7101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:44.053849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:53667 (local address 127.9.187.194:37061)
0808 17:44:44.053894 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:44.053896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:44.053909 (+ 13us) server_negotiation.cc:407] Connection header received
0808 17:44:44.053941 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:44.053941 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:44.053951 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:44.054011 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:44.054200 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:44.054715 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:44.055679 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:44.056034 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:44.056087 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:44.056094 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:44.056254 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 17:44:44.056297 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:44:44.056393 7105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:44.053876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:41173 (local address 127.9.187.195:42811)
0808 17:44:44.053922 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:44.053924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:44.054027 (+ 103us) server_negotiation.cc:407] Connection header received
0808 17:44:44.054094 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:44.054095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:44.054104 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:44.054201 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:44.054339 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:44.054823 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:44.055700 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:44.056061 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:44.056138 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:44.056146 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:44.056286 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 17:44:44.056325 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:44:44.056393 6650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:44.053762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:37061 (local address 127.9.187.193:53667)
0808 17:44:44.053812 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:44.053824 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:44.053882 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:44.054024 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:44.054025 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:44.054027 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:44.054106 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:44.054108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:44.054792 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:44.054794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:44.055594 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:44.055597 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:44.056112 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:44.056113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:44.056186 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:44.056190 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:44:44.056238 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 17:44:44.056282 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 17:44:44.056401 7118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:44.053764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:42811 (local address 127.9.187.193:41173)
0808 17:44:44.053965 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:44.053974 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:44.054026 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:44.054212 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:44.054213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:44.054215 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:44.054276 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:44.054278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:44.054900 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:44.054900 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:44.055610 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:44.055612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:44.056142 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:44.056143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:44.056211 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:44.056214 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:44.056265 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:44:44.056299 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":52,"thread_start_us":91,"threads_started":1}
I20260808 17:44:44.056748 6783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73a81023437c47d6806e291a76fc7804" candidate_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a98474fe41744c09e68de1bbc1d30e6" is_pre_election: true
I20260808 17:44:44.056795 7002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73a81023437c47d6806e291a76fc7804" candidate_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ec33b6682b4b3a9876dff14a51a164" is_pre_election: true
I20260808 17:44:44.056908 7002 raft_consensus.cc:2454] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2651cd46b7c40ef89582b7a884e1ce2 in term 0.
I20260808 17:44:44.056908 6783 raft_consensus.cc:2454] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2651cd46b7c40ef89582b7a884e1ce2 in term 0.
I20260808 17:44:44.057142 6452 leader_election.cc:302] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a98474fe41744c09e68de1bbc1d30e6, a2651cd46b7c40ef89582b7a884e1ce2; no voters:
I20260808 17:44:44.057296 7117 raft_consensus.cc:2781] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:44:44.057351 7117 raft_consensus.cc:482] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:44:44.057366 7117 raft_consensus.cc:3037] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:44.058041 7117 raft_consensus.cc:504] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39413 } } peers { permanent_uuid: "c1ec33b6682b4b3a9876dff14a51a164" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42811 } } peers { permanent_uuid: "4a98474fe41744c09e68de1bbc1d30e6" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 37061 } }
I20260808 17:44:44.058207 7117 leader_election.cc:288] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [CANDIDATE]: Term 1 election: Requested vote from peers c1ec33b6682b4b3a9876dff14a51a164 (127.9.187.195:42811), 4a98474fe41744c09e68de1bbc1d30e6 (127.9.187.194:37061)
I20260808 17:44:44.058378 6783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73a81023437c47d6806e291a76fc7804" candidate_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a98474fe41744c09e68de1bbc1d30e6"
I20260808 17:44:44.058378 7002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73a81023437c47d6806e291a76fc7804" candidate_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ec33b6682b4b3a9876dff14a51a164"
I20260808 17:44:44.058454 7002 raft_consensus.cc:3037] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:44.058454 6783 raft_consensus.cc:3037] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:44.059301 7002 raft_consensus.cc:2454] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2651cd46b7c40ef89582b7a884e1ce2 in term 1.
I20260808 17:44:44.059301 6783 raft_consensus.cc:2454] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2651cd46b7c40ef89582b7a884e1ce2 in term 1.
I20260808 17:44:44.059454 6452 leader_election.cc:302] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a98474fe41744c09e68de1bbc1d30e6, a2651cd46b7c40ef89582b7a884e1ce2; no voters:
I20260808 17:44:44.059542 7117 raft_consensus.cc:2781] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:44.059661 7117 raft_consensus.cc:686] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 1 LEADER]: Becoming Leader. State: Replica: a2651cd46b7c40ef89582b7a884e1ce2, State: Running, Role: LEADER
I20260808 17:44:44.059738 7117 consensus_queue.cc:237] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39413 } } peers { permanent_uuid: "c1ec33b6682b4b3a9876dff14a51a164" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42811 } } peers { permanent_uuid: "4a98474fe41744c09e68de1bbc1d30e6" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 37061 } }
I20260808 17:44:44.060508 6332 catalog_manager.cc:5495] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2651cd46b7c40ef89582b7a884e1ce2 (127.9.187.193). New cstate: current_term: 1 leader_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2651cd46b7c40ef89582b7a884e1ce2" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 39413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1ec33b6682b4b3a9876dff14a51a164" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a98474fe41744c09e68de1bbc1d30e6" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 37061 } health_report { overall_health: UNKNOWN } } }
I20260808 17:44:44.074811 7103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:44.072721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60418 (local address 127.9.187.193:39413)
0808 17:44:44.072771 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:44.072772 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:44.072780 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:44.072831 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:44.072832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:44.072848 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:44.072901 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:44:44.072998 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:44.073461 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:44.074203 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:44.074376 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:44.074423 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:44.074558 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:44:44.074647 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:44:44.074706 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:44.074720 (+ 14us) server_negotiation.cc:299] Negotiation successful
0808 17:44:44.074737 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:44:44.076426 6783 raft_consensus.cc:1261] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6 [term 1 FOLLOWER]: Refusing update from remote peer a2651cd46b7c40ef89582b7a884e1ce2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:44.076429 7002 raft_consensus.cc:1261] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164 [term 1 FOLLOWER]: Refusing update from remote peer a2651cd46b7c40ef89582b7a884e1ce2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:44.076740 7119 consensus_queue.cc:1035] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a98474fe41744c09e68de1bbc1d30e6" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:44.076857 7117 consensus_queue.cc:1035] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1ec33b6682b4b3a9876dff14a51a164" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 42811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:44.079105 7126 mvcc.cc:205] Tried to move back new op lower bound from 7316320600374693888 to 7316320600309264384. Current Snapshot: MvccSnapshot[applied={T|T < 7316320600374693888}]
I20260808 17:44:44.081961 6332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:44.082084 6332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:44.082815 6332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf855ca08bff45a793fe3ef06d07520b: Sending DeleteTablet for 3 replicas of tablet 73a81023437c47d6806e291a76fc7804
I20260808 17:44:44.083171 6753 tablet_service.cc:1514] Processing DeleteTablet for tablet 73a81023437c47d6806e291a76fc7804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:44 UTC) from {username='slave'} at 127.0.0.1:47774
I20260808 17:44:44.083194 6966 tablet_service.cc:1514] Processing DeleteTablet for tablet 73a81023437c47d6806e291a76fc7804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:44 UTC) from {username='slave'} at 127.0.0.1:43282
I20260808 17:44:44.083209 6535 tablet_service.cc:1514] Processing DeleteTablet for tablet 73a81023437c47d6806e291a76fc7804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:44 UTC) from {username='slave'} at 127.0.0.1:60406
I20260808 17:44:44.083472 7146 tablet_replica.cc:330] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2: stopping tablet replica
I20260808 17:44:44.083565 7146 raft_consensus.cc:2229] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:44:44.083563 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 6429
I20260808 17:44:44.083678 7146 raft_consensus.cc:2258] T 73a81023437c47d6806e291a76fc7804 P a2651cd46b7c40ef89582b7a884e1ce2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:44.084151 7145 tablet_replica.cc:330] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164: stopping tablet replica
I20260808 17:44:44.084249 7145 raft_consensus.cc:2229] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:44.084343 7145 raft_consensus.cc:2258] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:44.086318 7143 tablet_replica.cc:330] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6: stopping tablet replica
I20260808 17:44:44.086596 7143 raft_consensus.cc:2229] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:44.086705 7143 raft_consensus.cc:2258] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:44.086721 7145 ts_tablet_manager.cc:1905] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:44.088148 7145 ts_tablet_manager.cc:1918] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:44.088222 7145 log.cc:1196] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/73a81023437c47d6806e291a76fc7804
I20260808 17:44:44.088469 7145 ts_tablet_manager.cc:1939] T 73a81023437c47d6806e291a76fc7804 P c1ec33b6682b4b3a9876dff14a51a164: Deleting consensus metadata
I20260808 17:44:44.088630 7143 ts_tablet_manager.cc:1905] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:44.088908 6311 catalog_manager.cc:4841] TS c1ec33b6682b4b3a9876dff14a51a164 (127.9.187.195:42811): tablet 73a81023437c47d6806e291a76fc7804 (table test-table [id=fc6848c8cd184bc0b3d9fdb203d52c83]) successfully deleted
I20260808 17:44:44.089851 7143 ts_tablet_manager.cc:1918] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:44.089915 7143 log.cc:1196] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/73a81023437c47d6806e291a76fc7804
I20260808 17:44:44.090154 7143 ts_tablet_manager.cc:1939] T 73a81023437c47d6806e291a76fc7804 P 4a98474fe41744c09e68de1bbc1d30e6: Deleting consensus metadata
I20260808 17:44:44.093554 6307 catalog_manager.cc:4841] TS 4a98474fe41744c09e68de1bbc1d30e6 (127.9.187.194:37061): tablet 73a81023437c47d6806e291a76fc7804 (table test-table [id=fc6848c8cd184bc0b3d9fdb203d52c83]) successfully deleted
W20260808 17:44:44.097229 6311 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:39413 (error 108)
I20260808 17:44:44.097672 7096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:44.097560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:39413 (local address 127.0.0.1:60432)
0808 17:44:44.097608 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:44.097645 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:39413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 17:44:44.097757 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 6651
W20260808 17:44:44.097781 6311 catalog_manager.cc:4584] TS a2651cd46b7c40ef89582b7a884e1ce2 (127.9.187.193:39413): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 73a81023437c47d6806e291a76fc7804: Network error: Client connection negotiation failed: client connection to 127.9.187.193:39413: connect: Connection refused (error 111)
I20260808 17:44:44.103605 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 6856
I20260808 17:44:44.116443 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 6281
2026-08-08T17:44:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (724 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:44:44 dist-test-slave-bqcl krb5kdc[7152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:44:44 dist-test-slave-bqcl krb5kdc[7152](info): set up 2 sockets
Aug 08 17:44:44 dist-test-slave-bqcl krb5kdc[7152](info): commencing operation
krb5kdc: starting...
W20260808 17:44:45.265441 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:44:45 dist-test-slave-bqcl krb5kdc[7152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:44:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:44:45.384466 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33525
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:33525
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:45.464638 7168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:45.464839 7168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:45.464870 7168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:45.466009 7168 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:45.466054 7168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:45.466081 7168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:45.466096 7168 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:45.466113 7168 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:45.467617 7168 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:33525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:33525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:45.467815 7168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:45.467988 7168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:45.472910 7184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:45.472909 7178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:45.472927 7180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:45.473207 7168 server_base.cc:1034] running on GCE node
I20260808 17:44:45.473480 7168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:45.473778 7168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:45.475026 7168 hybrid_clock.cc:648] HybridClock initialized: now 1786211085475006 us; error 34 us; skew 500 ppm
Aug 08 17:44:45 dist-test-slave-bqcl krb5kdc[7152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211085, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:45.480557 7168 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:44:45.480994 7168 webserver.cc:460] Webserver started at http://127.9.187.254:34207/ using document root <none> and password file <none>
I20260808 17:44:45.481179 7168 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:45.481218 7168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:45.481312 7168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:45.482345 7168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "2933bf90fa7548f8bf60c7dc7c4edc26"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "8a7d78f788b30048ad55eeac0782a2e9"
server_key_iv: "6912358c639a65d3abb3a59f3fb64405"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.482637 7168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "2933bf90fa7548f8bf60c7dc7c4edc26"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "8a7d78f788b30048ad55eeac0782a2e9"
server_key_iv: "6912358c639a65d3abb3a59f3fb64405"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.483860 7168 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:44:45.484464 7193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:45.484633 7168 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:45.484719 7168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "2933bf90fa7548f8bf60c7dc7c4edc26"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "8a7d78f788b30048ad55eeac0782a2e9"
server_key_iv: "6912358c639a65d3abb3a59f3fb64405"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.484778 7168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:45.500138 7168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:45.501799 7168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:45.501930 7168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:45.505705 7168 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:33525
I20260808 17:44:45.505746 7280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:33525 every 8 connection(s)
I20260808 17:44:45.506042 7168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:45.506870 7282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:45.508963 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 7168
I20260808 17:44:45.509068 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:45.509117 7282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26: Bootstrap starting.
I20260808 17:44:45.509239 9967 external_mini_cluster.cc:1428] Setting key a05752dda2992a62877fc4862da888c3
I20260808 17:44:45.509757 7282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:45.510061 7282 log.cc:824] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:45.510769 7282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26: No bootstrap required, opened a new log
I20260808 17:44:45.512786 7282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2933bf90fa7548f8bf60c7dc7c4edc26" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33525 } }
I20260808 17:44:45.512944 7282 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:45.512972 7282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2933bf90fa7548f8bf60c7dc7c4edc26, State: Initialized, Role: FOLLOWER
I20260808 17:44:45.513088 7282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2933bf90fa7548f8bf60c7dc7c4edc26" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33525 } }
I20260808 17:44:45.513156 7282 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:45.513206 7282 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:45.513257 7282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:45.513757 7282 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2933bf90fa7548f8bf60c7dc7c4edc26" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33525 } }
I20260808 17:44:45.513864 7282 leader_election.cc:302] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2933bf90fa7548f8bf60c7dc7c4edc26; no voters:
I20260808 17:44:45.514019 7282 leader_election.cc:288] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:45.514197 7288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:45.514288 7282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:45.514346 7288 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [term 1 LEADER]: Becoming Leader. State: Replica: 2933bf90fa7548f8bf60c7dc7c4edc26, State: Running, Role: LEADER
I20260808 17:44:45.514421 7288 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2933bf90fa7548f8bf60c7dc7c4edc26" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33525 } }
I20260808 17:44:45.514741 7290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2933bf90fa7548f8bf60c7dc7c4edc26. Latest consensus state: current_term: 1 leader_uuid: "2933bf90fa7548f8bf60c7dc7c4edc26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2933bf90fa7548f8bf60c7dc7c4edc26" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33525 } } }
I20260808 17:44:45.514823 7290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:45.515030 7301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:45.515650 7289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2933bf90fa7548f8bf60c7dc7c4edc26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2933bf90fa7548f8bf60c7dc7c4edc26" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 33525 } } }
I20260808 17:44:45.515729 7289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26 [sys.catalog]: This master's current role is: LEADER
Aug 08 17:44:45 dist-test-slave-bqcl krb5kdc[7152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:45.516016 7301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:45.517696 7301 catalog_manager.cc:1347] Generated new cluster ID: c15d4a0f91b044ea80757ecd97f1c89a
I20260808 17:44:45.517746 7301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:45.519968 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.509695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40914 (local address 127.9.187.254:33525)
0808 17:44:45.509885 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:45.509894 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:45.509926 (+ 32us) server_negotiation.cc:407] Connection header received
0808 17:44:45.510404 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:45.510412 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:45.510460 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:45.510570 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:45.511312 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.512172 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.513198 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.513663 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.513749 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.516526 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:45.516530 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:45.516530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:45.516541 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:45.518449 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:45.518840 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:45.518842 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:45.518842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:45.518937 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:45.519132 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:45.519132 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:45.519133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:45.519391 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:45.519522 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:45.519645 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 17:44:45.519773 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":66,"threads_started":1}
I20260808 17:44:45.530252 7301 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:45.530733 7301 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:45.536903 7301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26: Generated new TSK 0
I20260808 17:44:45.537050 7301 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:44:45.564667 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33525
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:45.644085 7325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:45.644276 7325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:45.644299 7325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:45.645354 7325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:45.645387 7325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:45.645411 7325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:44:45.646749 7325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:45.646919 7325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:45.647080 7325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:45.651847 7339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:45.651934 7333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:45.651859 7334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:45.652024 7325 server_base.cc:1034] running on GCE node
I20260808 17:44:45.652244 7325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:45.652472 7325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:45.653609 7325 hybrid_clock.cc:648] HybridClock initialized: now 1786211085653597 us; error 27 us; skew 500 ppm
Aug 08 17:44:45 dist-test-slave-bqcl krb5kdc[7152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211085, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:45.655970 7325 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:44:45.656404 7325 webserver.cc:460] Webserver started at http://127.9.187.193:44519/ using document root <none> and password file <none>
I20260808 17:44:45.656607 7325 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:45.656654 7325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:45.656778 7325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:45.657750 7325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "24ee18d173ad4b26b47209858ceb4db0"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "60c9d2ebdc94ad2e264867d23e7e8436"
server_key_iv: "a0b4545a7e074a1f7a0ce874aa899d24"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.658070 7325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "24ee18d173ad4b26b47209858ceb4db0"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "60c9d2ebdc94ad2e264867d23e7e8436"
server_key_iv: "a0b4545a7e074a1f7a0ce874aa899d24"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.659446 7325 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:44:45.660110 7349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:45.660279 7325 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:45.660355 7325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "24ee18d173ad4b26b47209858ceb4db0"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "60c9d2ebdc94ad2e264867d23e7e8436"
server_key_iv: "a0b4545a7e074a1f7a0ce874aa899d24"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.660418 7325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:45.671430 7325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:45.673045 7325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:45.673168 7325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:45.673367 7325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:45.673637 7325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:45.673671 7325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:45.673697 7325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:45.673714 7325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:45.679077 7325 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:34621
I20260808 17:44:45.679129 7538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:34621 every 8 connection(s)
I20260808 17:44:45.679410 7325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:44:45 dist-test-slave-bqcl krb5kdc[7152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211085, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:45.687795 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.680065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:36955 (local address 127.9.187.254:33525)
0808 17:44:45.680126 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:45.680129 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:45.680287 (+ 158us) server_negotiation.cc:407] Connection header received
0808 17:44:45.680784 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:45.680785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:45.680798 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:45.680851 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:45.681748 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.682293 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.683267 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.683477 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.683535 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.685473 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:45.685475 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:45.685475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:45.685483 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:45.686577 (+ 1094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:45.686922 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:45.686923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:45.686923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:45.686978 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:45.687184 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:45.687185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:45.687185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:45.687314 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:45.687375 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:45.687620 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 17:44:45.687707 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:44:45.687944 7543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.680018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33525 (local address 127.9.187.193:36955)
0808 17:44:45.680181 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:45.680214 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:45.680692 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:45.680926 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:45.680929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:45.681467 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:45.681653 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.681658 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.682385 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.682386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.683186 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.683188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.683548 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.683549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.683667 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.684091 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:45.684099 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:45.685389 (+ 1290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:45.686647 (+ 1258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:45.686654 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:45.686657 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:45.686858 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:45.687031 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:45.687032 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:45.687032 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:45.687129 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:45.687365 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:45.687373 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:45.687502 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 17:44:45.687599 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 17:44:45.687746 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260808 17:44:45.688346 7539 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33525
I20260808 17:44:45.688454 7539 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:45.688611 7539 heartbeater.cc:511] Master 127.9.187.254:33525 requested a full tablet report, sending...
I20260808 17:44:45.689076 7223 ts_manager.cc:194] Registered new tserver with Master: 24ee18d173ad4b26b47209858ceb4db0 (127.9.187.193:34621)
I20260808 17:44:45.689200 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 7325
I20260808 17:44:45.689304 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:44:45.689512 9967 external_mini_cluster.cc:1428] Setting key 4ae3f8c1f6be87040c624df81454ae1c
I20260808 17:44:45.689852 7223 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:36955
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:44:45.713048 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33525
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:45.791848 7547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:45.792042 7547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:45.792073 7547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:45.793165 7547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:45.793203 7547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:45.793237 7547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:44:45.794647 7547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:45.794872 7547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:45.795078 7547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:45.799757 7560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:45.799779 7558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:45.799788 7557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:45.799943 7547 server_base.cc:1034] running on GCE node
I20260808 17:44:45.800153 7547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:45.800369 7547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:45.801507 7547 hybrid_clock.cc:648] HybridClock initialized: now 1786211085801488 us; error 28 us; skew 500 ppm
Aug 08 17:44:45 dist-test-slave-bqcl krb5kdc[7152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211085, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:45.803853 7547 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:44:45.804226 7547 webserver.cc:460] Webserver started at http://127.9.187.194:45165/ using document root <none> and password file <none>
I20260808 17:44:45.804404 7547 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:45.804442 7547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:45.804531 7547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:45.805480 7547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "c29f228899a34fde92192b0ec3ef8cf4"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "9b516a363326eb71dd77459407b8abd8"
server_key_iv: "0cdf28e384967ffc0503e62f3493f3c2"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.805768 7547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "c29f228899a34fde92192b0ec3ef8cf4"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "9b516a363326eb71dd77459407b8abd8"
server_key_iv: "0cdf28e384967ffc0503e62f3493f3c2"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.806975 7547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:44:45.807660 7574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:45.807811 7547 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:44:45.807890 7547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "c29f228899a34fde92192b0ec3ef8cf4"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "9b516a363326eb71dd77459407b8abd8"
server_key_iv: "0cdf28e384967ffc0503e62f3493f3c2"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.807952 7547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:45.815207 7547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:45.816969 7547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:45.817087 7547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:45.817270 7547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:45.817533 7547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:45.817577 7547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:45.817598 7547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:45.817621 7547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:45.822908 7547 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:39641
I20260808 17:44:45.822968 7764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:39641 every 8 connection(s)
I20260808 17:44:45.823228 7547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:44:45.827440 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 7547
I20260808 17:44:45.827538 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:44:45.827713 9967 external_mini_cluster.cc:1428] Setting key b17b401c190cc15bf75d6fbe2d9281f2
Aug 08 17:44:45 dist-test-slave-bqcl krb5kdc[7152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211085, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:45.832163 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.823839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:40789 (local address 127.9.187.254:33525)
0808 17:44:45.823887 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:45.823889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:45.824066 (+ 177us) server_negotiation.cc:407] Connection header received
0808 17:44:45.824481 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:45.824481 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:45.824490 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:45.824543 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:45.825391 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.825875 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.826919 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.827119 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.827174 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.829454 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:45.829455 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:45.829456 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:45.829462 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:45.830895 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:45.831264 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:45.831265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:45.831265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:45.831328 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:45.831539 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:45.831541 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:45.831542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:45.831677 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:45.831739 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:45.831990 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 17:44:45.832077 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:44:45.832324 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.823802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33525 (local address 127.9.187.194:40789)
0808 17:44:45.823947 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:45.823986 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:45.824410 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:45.824603 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:45.824606 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:45.825130 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:45.825325 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.825329 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.825934 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.825935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.826839 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.826842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.827178 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.827178 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.827296 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.827724 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:45.827732 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:45.829373 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:45.830974 (+ 1601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:45.830981 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:45.830982 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:45.831196 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:45.831385 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:45.831385 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:45.831386 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:45.831471 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:45.831743 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:45.831749 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:45.831869 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 17:44:45.831955 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 17:44:45.832116 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260808 17:44:45.832727 7765 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33525
I20260808 17:44:45.832820 7765 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:45.832985 7765 heartbeater.cc:511] Master 127.9.187.254:33525 requested a full tablet report, sending...
I20260808 17:44:45.833335 7222 ts_manager.cc:194] Registered new tserver with Master: c29f228899a34fde92192b0ec3ef8cf4 (127.9.187.194:39641)
I20260808 17:44:45.833698 7222 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:40789
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:44:45.851096 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33525
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:45.929895 7771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:45.930091 7771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:45.930114 7771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:45.931238 7771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:45.931278 7771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:45.931303 7771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:44:45.932670 7771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:33525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:45.932879 7771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:45.933089 7771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:45.937685 7784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:45.937693 7782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:45.937666 7786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:45.937906 7771 server_base.cc:1034] running on GCE node
I20260808 17:44:45.938118 7771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:45.938378 7771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:45.939522 7771 hybrid_clock.cc:648] HybridClock initialized: now 1786211085939514 us; error 33 us; skew 500 ppm
Aug 08 17:44:45 dist-test-slave-bqcl krb5kdc[7152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211085, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:45.941773 7771 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:44:45.942221 7771 webserver.cc:460] Webserver started at http://127.9.187.195:42613/ using document root <none> and password file <none>
I20260808 17:44:45.942433 7771 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:45.942481 7771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:45.942606 7771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:45.943562 7771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "cc70139d31e14404b789c7efe483b380"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "f45d331f2921942b723d18321bcaae13"
server_key_iv: "90a2bad681ebf200a355277763532348"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.943887 7771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "cc70139d31e14404b789c7efe483b380"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "f45d331f2921942b723d18321bcaae13"
server_key_iv: "90a2bad681ebf200a355277763532348"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.945043 7771 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:44:45.945716 7801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:45.945871 7771 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:45.945952 7771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "cc70139d31e14404b789c7efe483b380"
format_stamp: "Formatted at 2026-08-08 17:44:45 on dist-test-slave-bqcl"
server_key: "f45d331f2921942b723d18321bcaae13"
server_key_iv: "90a2bad681ebf200a355277763532348"
server_key_version: "encryptionkey@0"
I20260808 17:44:45.946022 7771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:45.954790 7771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:45.956434 7771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:45.956555 7771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:45.956744 7771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:45.957011 7771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:45.957044 7771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:45.957070 7771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:45.957095 7771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:45.962414 7771 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:33019
I20260808 17:44:45.962451 7986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:33019 every 8 connection(s)
I20260808 17:44:45.962738 7771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:44:45.965019 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 7771
I20260808 17:44:45.965152 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:44:45.965389 9967 external_mini_cluster.cc:1428] Setting key de771935030bbe015817321831e08439
Aug 08 17:44:45 dist-test-slave-bqcl krb5kdc[7152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211085, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:45.971387 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.963478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:43095 (local address 127.9.187.254:33525)
0808 17:44:45.963591 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:45.963593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:45.963668 (+ 75us) server_negotiation.cc:407] Connection header received
0808 17:44:45.964185 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:45.964186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:45.964197 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:45.964253 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:45.965334 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.965929 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.966934 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.967135 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.967190 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.969200 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:45.969202 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:45.969202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:45.969208 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:45.970344 (+ 1136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:45.970716 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:45.970716 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:45.970717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:45.970762 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:45.970939 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:45.970939 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:45.970939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:45.971029 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:45.971072 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:45.971270 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 17:44:45.971324 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 17:44:45.971581 7992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.963382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:33525 (local address 127.9.187.195:43095)
0808 17:44:45.963540 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:45.963589 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:45.964085 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:45.964309 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:45.964312 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:45.964939 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:45.965225 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.965233 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.966010 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.966011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.966851 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.966853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.967210 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.967211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.967338 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.967747 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:45.967755 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:45.969107 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:45.970411 (+ 1304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:45.970417 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:45.970419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:45.970654 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:45.970805 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:45.970805 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:45.970806 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:45.970897 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:45.971069 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:45.971071 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:45.971178 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 17:44:45.971255 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 17:44:45.971368 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
I20260808 17:44:45.971999 7987 heartbeater.cc:347] Connected to a master server at 127.9.187.254:33525
I20260808 17:44:45.972084 7987 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:45.972250 7987 heartbeater.cc:511] Master 127.9.187.254:33525 requested a full tablet report, sending...
I20260808 17:44:45.972592 7222 ts_manager.cc:194] Registered new tserver with Master: cc70139d31e14404b789c7efe483b380 (127.9.187.195:33019)
I20260808 17:44:45.972941 7222 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:43095
I20260808 17:44:45.976985 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:44:45.983472 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.978293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55094 (local address 127.9.187.254:33525)
0808 17:44:45.978340 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:45.978342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:45.978436 (+ 94us) server_negotiation.cc:407] Connection header received
0808 17:44:45.978478 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:45.978479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:45.978486 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:45.978529 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:45.978996 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.979426 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.980120 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.980282 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.980321 (+ 39us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.981453 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:45.981454 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:45.981454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:45.981459 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:45.982490 (+ 1031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:45.982873 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:45.982874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:45.982874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:45.982918 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:45.983092 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:45.983093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:45.983093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:45.983200 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:45.983272 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:45.983372 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 17:44:45.983416 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:44:45.985066 7222 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55094:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:44:45.986604 7222 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:44:45.992947 8000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.988665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33218 (local address 127.9.187.195:33019)
0808 17:44:45.989212 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:45.989215 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:45.989223 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:45.989254 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:45.989256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:45.989268 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:45.989343 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:45.989423 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.990461 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.992064 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.992544 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.992614 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.992671 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:45.992828 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 17:44:45.992871 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":75,"threads_started":1}
I20260808 17:44:45.992939 8001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.988581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:33019 (local address 127.0.0.1:33218)
0808 17:44:45.988903 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:45.988915 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:45.988967 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:45.989342 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:45.989342 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:45.989344 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:45.989375 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.989376 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.990541 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.990542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.991981 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.991983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.992627 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.992628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.992709 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.992723 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:44:45.992802 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 17:44:45.992856 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":28,"thread_start_us":57,"threads_started":1}
I20260808 17:44:45.992996 8002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.988773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49470 (local address 127.9.187.193:34621)
0808 17:44:45.988957 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:45.988962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:45.988972 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:44:45.989010 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:45.989012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:45.989026 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:45.989091 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:45.989269 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.990411 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.992001 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.992690 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.992743 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.992783 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:45.992881 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 17:44:45.992922 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":76,"threads_started":1}
I20260808 17:44:45.993361 7998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.988576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:34621 (local address 127.0.0.1:49470)
0808 17:44:45.988774 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:45.988816 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:45.988879 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:45.989118 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:45.989121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:45.989123 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:45.989199 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.989201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.990527 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.990528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.991903 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.991906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.992750 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.992751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.992805 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.992808 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:45.992869 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 17:44:45.992900 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":48,"thread_start_us":40,"threads_started":1}
I20260808 17:44:45.993599 7876 tablet_service.cc:1467] Processing CreateTablet for tablet a6429e144ace4816a6f000d4ec772311 (DEFAULT_TABLE table=test-table [id=62eef411ab914ed0b97f44a959d6249d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:45.993953 7876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6429e144ace4816a6f000d4ec772311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:45.994189 7428 tablet_service.cc:1467] Processing CreateTablet for tablet a6429e144ace4816a6f000d4ec772311 (DEFAULT_TABLE table=test-table [id=62eef411ab914ed0b97f44a959d6249d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:45.994379 7999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.988758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:39641 (local address 127.0.0.1:57444)
0808 17:44:45.989186 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:45.989196 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:45.989256 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:45.990660 (+ 1404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:45.990661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:45.990663 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:45.990720 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.990722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.991571 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.991571 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.992540 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:45.992543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.994153 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.994154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:45.994215 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.994219 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:44:45.994278 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:44:45.994317 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":93,"threads_started":1}
I20260808 17:44:45.994583 7428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6429e144ace4816a6f000d4ec772311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:45.994684 8004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:45.989003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57444 (local address 127.9.187.194:39641)
0808 17:44:45.989182 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:45.989186 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:45.990519 (+ 1333us) server_negotiation.cc:407] Connection header received
0808 17:44:45.990562 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:45.990565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:45.990580 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:45.990647 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:45.990774 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.991473 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.993166 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:45.993871 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:45.994031 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:45.994089 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:45.994549 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 17:44:45.994600 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260808 17:44:45.995306 7656 tablet_service.cc:1467] Processing CreateTablet for tablet a6429e144ace4816a6f000d4ec772311 (DEFAULT_TABLE table=test-table [id=62eef411ab914ed0b97f44a959d6249d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:45.995640 7656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6429e144ace4816a6f000d4ec772311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:45.997248 8005 tablet_bootstrap.cc:492] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380: Bootstrap starting.
I20260808 17:44:45.997575 8006 tablet_bootstrap.cc:492] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0: Bootstrap starting.
I20260808 17:44:45.997936 8005 tablet_bootstrap.cc:654] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:45.998234 8006 tablet_bootstrap.cc:654] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:45.998422 8007 tablet_bootstrap.cc:492] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: Bootstrap starting.
I20260808 17:44:45.998723 8005 log.cc:824] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:45.999004 8007 tablet_bootstrap.cc:654] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:45.999056 8006 log.cc:824] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:45.999502 8005 tablet_bootstrap.cc:492] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380: No bootstrap required, opened a new log
I20260808 17:44:45.999521 8007 log.cc:824] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:45.999583 8005 ts_tablet_manager.cc:1397] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:45.999835 8006 tablet_bootstrap.cc:492] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0: No bootstrap required, opened a new log
I20260808 17:44:45.999910 8006 ts_tablet_manager.cc:1397] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:44:46.000159 8007 tablet_bootstrap.cc:492] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: No bootstrap required, opened a new log
I20260808 17:44:46.000217 8007 ts_tablet_manager.cc:1397] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:44:46.001463 8007 raft_consensus.cc:348] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc70139d31e14404b789c7efe483b380" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 33019 } } peers { permanent_uuid: "24ee18d173ad4b26b47209858ceb4db0" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34621 } } peers { permanent_uuid: "c29f228899a34fde92192b0ec3ef8cf4" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 39641 } }
I20260808 17:44:46.001596 8007 raft_consensus.cc:374] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:46.001628 8007 raft_consensus.cc:729] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c29f228899a34fde92192b0ec3ef8cf4, State: Initialized, Role: FOLLOWER
I20260808 17:44:46.001539 8005 raft_consensus.cc:348] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc70139d31e14404b789c7efe483b380" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 33019 } } peers { permanent_uuid: "24ee18d173ad4b26b47209858ceb4db0" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34621 } } peers { permanent_uuid: "c29f228899a34fde92192b0ec3ef8cf4" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 39641 } }
I20260808 17:44:46.001765 8005 raft_consensus.cc:374] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:46.001757 8007 consensus_queue.cc:260] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc70139d31e14404b789c7efe483b380" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 33019 } } peers { permanent_uuid: "24ee18d173ad4b26b47209858ceb4db0" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34621 } } peers { permanent_uuid: "c29f228899a34fde92192b0ec3ef8cf4" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 39641 } }
I20260808 17:44:46.001827 8005 raft_consensus.cc:729] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc70139d31e14404b789c7efe483b380, State: Initialized, Role: FOLLOWER
I20260808 17:44:46.001845 8006 raft_consensus.cc:348] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc70139d31e14404b789c7efe483b380" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 33019 } } peers { permanent_uuid: "24ee18d173ad4b26b47209858ceb4db0" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34621 } } peers { permanent_uuid: "c29f228899a34fde92192b0ec3ef8cf4" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 39641 } }
I20260808 17:44:46.002008 8006 raft_consensus.cc:374] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:46.002012 8007 ts_tablet_manager.cc:1428] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:46.001976 8005 consensus_queue.cc:260] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc70139d31e14404b789c7efe483b380" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 33019 } } peers { permanent_uuid: "24ee18d173ad4b26b47209858ceb4db0" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34621 } } peers { permanent_uuid: "c29f228899a34fde92192b0ec3ef8cf4" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 39641 } }
I20260808 17:44:46.002044 8006 raft_consensus.cc:729] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24ee18d173ad4b26b47209858ceb4db0, State: Initialized, Role: FOLLOWER
I20260808 17:44:46.002149 7765 heartbeater.cc:503] Master 127.9.187.254:33525 was elected leader, sending a full tablet report...
I20260808 17:44:46.002283 8005 ts_tablet_manager.cc:1428] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:44:46.002242 8006 consensus_queue.cc:260] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc70139d31e14404b789c7efe483b380" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 33019 } } peers { permanent_uuid: "24ee18d173ad4b26b47209858ceb4db0" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34621 } } peers { permanent_uuid: "c29f228899a34fde92192b0ec3ef8cf4" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 39641 } }
I20260808 17:44:46.002393 7987 heartbeater.cc:503] Master 127.9.187.254:33525 was elected leader, sending a full tablet report...
I20260808 17:44:46.002787 7539 heartbeater.cc:503] Master 127.9.187.254:33525 was elected leader, sending a full tablet report...
I20260808 17:44:46.002914 8006 ts_tablet_manager.cc:1428] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
W20260808 17:44:46.073740 7766 tablet.cc:2369] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:44:46.101501 8022 raft_consensus.cc:482] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:46.101656 8022 raft_consensus.cc:504] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc70139d31e14404b789c7efe483b380" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 33019 } } peers { permanent_uuid: "24ee18d173ad4b26b47209858ceb4db0" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34621 } } peers { permanent_uuid: "c29f228899a34fde92192b0ec3ef8cf4" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 39641 } }
I20260808 17:44:46.101992 8022 leader_election.cc:288] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24ee18d173ad4b26b47209858ceb4db0 (127.9.187.193:34621), c29f228899a34fde92192b0ec3ef8cf4 (127.9.187.194:39641)
I20260808 17:44:46.104820 8002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.102259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:57287 (local address 127.9.187.193:34621)
0808 17:44:46.102321 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.102323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.102334 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:44:46.102361 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.102362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.102374 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.102420 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:46.102583 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.103119 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.104083 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.104494 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.104563 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.104572 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.104710 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.104753 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 17:44:46.104820 7992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.102190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:34621 (local address 127.9.187.195:57287)
0808 17:44:46.102245 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.102255 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:46.102298 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:46.102429 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:46.102430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:46.102431 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:46.102507 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.102509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.103194 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.103195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.103964 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.103966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.104569 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.104570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.104651 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.104654 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:46.104709 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 17:44:46.104749 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 17:44:46.104938 8004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.102445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:35441 (local address 127.9.187.194:39641)
0808 17:44:46.102502 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.102503 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.102511 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:46.102534 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.102535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.102544 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.102596 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:46.102732 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.103205 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.104169 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.104579 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.104647 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.104655 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.104822 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.104871 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:44:46.105157 8027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.102195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:39641 (local address 127.9.187.195:35441)
0808 17:44:46.102386 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.102397 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:46.102452 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:46.102608 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:46.102608 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:46.102610 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:46.102677 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.102678 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.103298 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.103299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.104090 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.104092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.104659 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.104660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.104732 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.104736 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:44:46.105021 (+ 285us) client_negotiation.cc:240] Negotiation successful
0808 17:44:46.105076 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":23,"thread_start_us":107,"threads_started":1}
I20260808 17:44:46.105362 7462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6429e144ace4816a6f000d4ec772311" candidate_uuid: "cc70139d31e14404b789c7efe483b380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ee18d173ad4b26b47209858ceb4db0" is_pre_election: true
I20260808 17:44:46.105510 7462 raft_consensus.cc:2454] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc70139d31e14404b789c7efe483b380 in term 0.
I20260808 17:44:46.105500 7693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6429e144ace4816a6f000d4ec772311" candidate_uuid: "cc70139d31e14404b789c7efe483b380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c29f228899a34fde92192b0ec3ef8cf4" is_pre_election: true
I20260808 17:44:46.105647 7693 raft_consensus.cc:2454] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc70139d31e14404b789c7efe483b380 in term 0.
I20260808 17:44:46.105780 7803 leader_election.cc:302] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24ee18d173ad4b26b47209858ceb4db0, cc70139d31e14404b789c7efe483b380; no voters:
I20260808 17:44:46.105919 8022 raft_consensus.cc:2781] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:44:46.105978 8022 raft_consensus.cc:482] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:44:46.106001 8022 raft_consensus.cc:3037] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:46.106769 8022 raft_consensus.cc:504] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc70139d31e14404b789c7efe483b380" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 33019 } } peers { permanent_uuid: "24ee18d173ad4b26b47209858ceb4db0" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34621 } } peers { permanent_uuid: "c29f228899a34fde92192b0ec3ef8cf4" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 39641 } }
I20260808 17:44:46.106885 8022 leader_election.cc:288] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [CANDIDATE]: Term 1 election: Requested vote from peers 24ee18d173ad4b26b47209858ceb4db0 (127.9.187.193:34621), c29f228899a34fde92192b0ec3ef8cf4 (127.9.187.194:39641)
I20260808 17:44:46.107035 7693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6429e144ace4816a6f000d4ec772311" candidate_uuid: "cc70139d31e14404b789c7efe483b380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c29f228899a34fde92192b0ec3ef8cf4"
I20260808 17:44:46.107065 7462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6429e144ace4816a6f000d4ec772311" candidate_uuid: "cc70139d31e14404b789c7efe483b380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ee18d173ad4b26b47209858ceb4db0"
I20260808 17:44:46.107113 7693 raft_consensus.cc:3037] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:46.107134 7462 raft_consensus.cc:3037] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:46.107824 7693 raft_consensus.cc:2454] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc70139d31e14404b789c7efe483b380 in term 1.
I20260808 17:44:46.107869 7462 raft_consensus.cc:2454] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc70139d31e14404b789c7efe483b380 in term 1.
I20260808 17:44:46.108009 7805 leader_election.cc:302] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c29f228899a34fde92192b0ec3ef8cf4, cc70139d31e14404b789c7efe483b380; no voters:
I20260808 17:44:46.108119 8022 raft_consensus.cc:2781] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:46.108270 8022 raft_consensus.cc:686] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 1 LEADER]: Becoming Leader. State: Replica: cc70139d31e14404b789c7efe483b380, State: Running, Role: LEADER
I20260808 17:44:46.108356 8022 consensus_queue.cc:237] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc70139d31e14404b789c7efe483b380" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 33019 } } peers { permanent_uuid: "24ee18d173ad4b26b47209858ceb4db0" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34621 } } peers { permanent_uuid: "c29f228899a34fde92192b0ec3ef8cf4" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 39641 } }
I20260808 17:44:46.109138 7222 catalog_manager.cc:5495] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc70139d31e14404b789c7efe483b380 (127.9.187.195). New cstate: current_term: 1 leader_uuid: "cc70139d31e14404b789c7efe483b380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc70139d31e14404b789c7efe483b380" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 33019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24ee18d173ad4b26b47209858ceb4db0" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c29f228899a34fde92192b0ec3ef8cf4" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 39641 } health_report { overall_health: UNKNOWN } } }
I20260808 17:44:46.137887 8000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.135631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33228 (local address 127.9.187.195:33019)
0808 17:44:46.135675 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.135677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.135685 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:46.135736 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.135737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.135752 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.135811 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:44:46.135941 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.136408 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.137152 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.137343 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.137396 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.137559 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:44:46.137657 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:44:46.137742 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.137787 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.137797 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:44:46.139657 7462 raft_consensus.cc:1261] T a6429e144ace4816a6f000d4ec772311 P 24ee18d173ad4b26b47209858ceb4db0 [term 1 FOLLOWER]: Refusing update from remote peer cc70139d31e14404b789c7efe483b380: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:46.139674 7693 raft_consensus.cc:1261] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4 [term 1 FOLLOWER]: Refusing update from remote peer cc70139d31e14404b789c7efe483b380: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:46.140020 8029 consensus_queue.cc:1035] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24ee18d173ad4b26b47209858ceb4db0" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:46.140147 8022 consensus_queue.cc:1035] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c29f228899a34fde92192b0ec3ef8cf4" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 39641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:46.143172 8037 mvcc.cc:205] Tried to move back new op lower bound from 7316320608825401344 to 7316320608700452864. Current Snapshot: MvccSnapshot[applied={T|T < 7316320608825401344 or (T in {7316320608825401344})}]
I20260808 17:44:46.144629 7223 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:46.144727 7223 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:46.145475 7223 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2933bf90fa7548f8bf60c7dc7c4edc26: Sending DeleteTablet for 3 replicas of tablet a6429e144ace4816a6f000d4ec772311
I20260808 17:44:46.145809 7428 tablet_service.cc:1514] Processing DeleteTablet for tablet a6429e144ace4816a6f000d4ec772311 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:46 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:49470
I20260808 17:44:46.145828 7876 tablet_service.cc:1514] Processing DeleteTablet for tablet a6429e144ace4816a6f000d4ec772311 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:46 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:33218
I20260808 17:44:46.145856 7656 tablet_service.cc:1514] Processing DeleteTablet for tablet a6429e144ace4816a6f000d4ec772311 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:46 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:57444
I20260808 17:44:46.146028 8045 tablet_replica.cc:330] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380: stopping tablet replica
I20260808 17:44:46.146147 8045 raft_consensus.cc:2229] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:44:46.146163 8047 tablet_replica.cc:330] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: stopping tablet replica
I20260808 17:44:46.146243 8045 raft_consensus.cc:2258] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:46.146256 8047 raft_consensus.cc:2229] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:46.146350 8047 raft_consensus.cc:2258] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:46.146451 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 7325
I20260808 17:44:46.146660 8045 ts_tablet_manager.cc:1905] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:46.146782 8047 ts_tablet_manager.cc:1905] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:46.148361 8045 ts_tablet_manager.cc:1918] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:46.148430 8045 log.cc:1196] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/a6429e144ace4816a6f000d4ec772311
I20260808 17:44:46.148730 8045 ts_tablet_manager.cc:1939] T a6429e144ace4816a6f000d4ec772311 P cc70139d31e14404b789c7efe483b380: Deleting consensus metadata
I20260808 17:44:46.151085 8047 ts_tablet_manager.cc:1918] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:46.151165 8047 log.cc:1196] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/a6429e144ace4816a6f000d4ec772311
I20260808 17:44:46.151510 8047 ts_tablet_manager.cc:1939] T a6429e144ace4816a6f000d4ec772311 P c29f228899a34fde92192b0ec3ef8cf4: Deleting consensus metadata
I20260808 17:44:46.162621 7198 catalog_manager.cc:4841] TS c29f228899a34fde92192b0ec3ef8cf4 (127.9.187.194:39641): tablet a6429e144ace4816a6f000d4ec772311 (table test-table [id=62eef411ab914ed0b97f44a959d6249d]) successfully deleted
I20260808 17:44:46.164079 7198 catalog_manager.cc:4841] TS cc70139d31e14404b789c7efe483b380 (127.9.187.195:33019): tablet a6429e144ace4816a6f000d4ec772311 (table test-table [id=62eef411ab914ed0b97f44a959d6249d]) successfully deleted
W20260808 17:44:46.168949 7194 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:34621 (error 108)
I20260808 17:44:46.169210 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 7547
I20260808 17:44:46.169461 7999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.169343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:34621 (local address 127.0.0.1:49482)
0808 17:44:46.169395 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.169426 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:34621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 17:44:46.169570 7194 catalog_manager.cc:4584] TS 24ee18d173ad4b26b47209858ceb4db0 (127.9.187.193:34621): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a6429e144ace4816a6f000d4ec772311: Network error: Client connection negotiation failed: client connection to 127.9.187.193:34621: connect: Connection refused (error 111)
I20260808 17:44:46.197773 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 7771
I20260808 17:44:46.212435 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 7168
2026-08-08T17:44:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2094 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T17:44:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:46Z Disabled control of system clock
I20260808 17:44:46.242069 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:45455
--webserver_interface=127.9.187.254
--webserver_port=0
--builtin_ntp_servers=127.9.187.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:45455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:44:46.321151 8053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:46.321350 8053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:46.321369 8053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:46.322477 8053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:46.322517 8053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:46.322535 8053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:46.322546 8053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:46.322561 8053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:46.323838 8053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:45455
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:45455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:46.324024 8053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:46.324249 8053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:46.328724 8064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:46.328841 8053 server_base.cc:1034] running on GCE node
W20260808 17:44:46.328732 8059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:46.328737 8062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:46.329177 8053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:46.329457 8053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:46.330592 8053 hybrid_clock.cc:648] HybridClock initialized: now 1786211086330574 us; error 35 us; skew 500 ppm
I20260808 17:44:46.331735 8053 webserver.cc:460] Webserver started at http://127.9.187.254:38405/ using document root <none> and password file <none>
I20260808 17:44:46.331941 8053 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:46.331990 8053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:46.332123 8053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:46.333084 8053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "c678ed0574994cc3b2b9f095cf6e5add"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "3e0222832c457abad297f9f6580903fd"
server_key_iv: "a4f1c1e297d98a603bde3547a79b10f0"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.333408 8053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "c678ed0574994cc3b2b9f095cf6e5add"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "3e0222832c457abad297f9f6580903fd"
server_key_iv: "a4f1c1e297d98a603bde3547a79b10f0"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.334614 8053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:44:46.335281 8076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.335421 8053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:46.335511 8053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "c678ed0574994cc3b2b9f095cf6e5add"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "3e0222832c457abad297f9f6580903fd"
server_key_iv: "a4f1c1e297d98a603bde3547a79b10f0"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.335572 8053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:46.344542 8053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:46.344785 8053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:46.344900 8053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:46.348536 8053 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:45455
I20260808 17:44:46.348564 8171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:45455 every 8 connection(s)
I20260808 17:44:46.348838 8053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:46.349709 8173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:46.351836 8173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add: Bootstrap starting.
I20260808 17:44:46.352353 8173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:46.352609 8173 log.cc:824] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:46.353209 8173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add: No bootstrap required, opened a new log
I20260808 17:44:46.354813 8173 raft_consensus.cc:348] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c678ed0574994cc3b2b9f095cf6e5add" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 45455 } }
I20260808 17:44:46.354940 8173 raft_consensus.cc:374] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:46.354964 8173 raft_consensus.cc:729] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c678ed0574994cc3b2b9f095cf6e5add, State: Initialized, Role: FOLLOWER
I20260808 17:44:46.355096 8173 consensus_queue.cc:260] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c678ed0574994cc3b2b9f095cf6e5add" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 45455 } }
I20260808 17:44:46.355154 8173 raft_consensus.cc:388] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:46.355176 8173 raft_consensus.cc:482] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:46.355221 8173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:46.355671 8173 raft_consensus.cc:504] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c678ed0574994cc3b2b9f095cf6e5add" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 45455 } }
I20260808 17:44:46.355763 8173 leader_election.cc:302] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c678ed0574994cc3b2b9f095cf6e5add; no voters:
I20260808 17:44:46.355912 8173 leader_election.cc:288] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:46.356048 8178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:46.356168 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 8053
I20260808 17:44:46.356192 8173 sys_catalog.cc:564] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:46.356215 8178 raft_consensus.cc:686] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [term 1 LEADER]: Becoming Leader. State: Replica: c678ed0574994cc3b2b9f095cf6e5add, State: Running, Role: LEADER
I20260808 17:44:46.356276 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:46.356343 8178 consensus_queue.cc:237] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c678ed0574994cc3b2b9f095cf6e5add" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 45455 } }
I20260808 17:44:46.356463 9967 external_mini_cluster.cc:1428] Setting key 142808a9066f5090f8bdd3dc722329d7
I20260808 17:44:46.356712 8179 sys_catalog.cc:455] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c678ed0574994cc3b2b9f095cf6e5add" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c678ed0574994cc3b2b9f095cf6e5add" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 45455 } } }
I20260808 17:44:46.356792 8179 sys_catalog.cc:458] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:46.356786 8181 sys_catalog.cc:455] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [sys.catalog]: SysCatalogTable state changed. Reason: New leader c678ed0574994cc3b2b9f095cf6e5add. Latest consensus state: current_term: 1 leader_uuid: "c678ed0574994cc3b2b9f095cf6e5add" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c678ed0574994cc3b2b9f095cf6e5add" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 45455 } } }
I20260808 17:44:46.356986 8181 sys_catalog.cc:458] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:46.357141 8191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:46.357648 8191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:46.359148 8191 catalog_manager.cc:1347] Generated new cluster ID: 98832f471ca54bbca47464a37e3d80dc
I20260808 17:44:46.359225 8191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:46.362192 8193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.357075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49300 (local address 127.9.187.254:45455)
0808 17:44:46.357968 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.357977 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.358007 (+ 30us) server_negotiation.cc:407] Connection header received
0808 17:44:46.358209 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.358216 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.358284 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.358419 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:46.358657 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.359646 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.360405 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.360818 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.360932 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.361534 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:46.361538 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:46.361539 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:46.361716 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:46.361749 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:46.361759 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:46.361813 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.361901 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.361977 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":113,"threads_started":1}
I20260808 17:44:46.370185 8191 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:46.370826 8191 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:46.374379 8191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add: Generated new TSK 0
I20260808 17:44:46.374549 8191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:44:46.375978 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:45455
--builtin_ntp_servers=127.9.187.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:44:46.465638 8208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:46.465833 8208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:46.465852 8208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:46.467003 8208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:46.467052 8208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:46.467077 8208 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:44:46.468392 8208 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:45455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:46.468616 8208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:46.468895 8208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:46.474690 8213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:46.474701 8215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:46.475045 8208 server_base.cc:1034] running on GCE node
W20260808 17:44:46.474750 8217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:46.475328 8208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:46.475606 8208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:46.476785 8208 hybrid_clock.cc:648] HybridClock initialized: now 1786211086476763 us; error 40 us; skew 500 ppm
I20260808 17:44:46.478190 8208 webserver.cc:460] Webserver started at http://127.9.187.193:39797/ using document root <none> and password file <none>
I20260808 17:44:46.478444 8208 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:46.478497 8208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:46.478621 8208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:46.480033 8208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "8fef29cb5adb42f095f0484654e2142a"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "a7ce4f37671fde4c3d2eda2804931f43"
server_key_iv: "7e52eabf3175fb174c55c2e8428d792f"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.480402 8208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "8fef29cb5adb42f095f0484654e2142a"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "a7ce4f37671fde4c3d2eda2804931f43"
server_key_iv: "7e52eabf3175fb174c55c2e8428d792f"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.481900 8208 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:44:46.482752 8227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.482905 8208 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.482996 8208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "8fef29cb5adb42f095f0484654e2142a"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "a7ce4f37671fde4c3d2eda2804931f43"
server_key_iv: "7e52eabf3175fb174c55c2e8428d792f"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.483065 8208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:46.512447 8208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:46.512733 8208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:46.512838 8208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:46.513023 8208 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:46.513298 8208 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:46.513335 8208 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.513357 8208 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:46.513374 8208 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.518837 8208 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:32799
I20260808 17:44:46.518893 8399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:32799 every 8 connection(s)
I20260808 17:44:46.519203 8208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:44:46.523108 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 8208
I20260808 17:44:46.523221 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:44:46.523443 9967 external_mini_cluster.cc:1428] Setting key 8de4651d4d35f4661704f0022eb93569
I20260808 17:44:46.524271 8193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.519871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:49955 (local address 127.9.187.254:45455)
0808 17:44:46.519932 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.519935 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.520179 (+ 244us) server_negotiation.cc:407] Connection header received
0808 17:44:46.520657 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.520658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.520671 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.520723 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:46.521350 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.521827 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.522834 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.523025 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.523071 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.524016 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:46.524017 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:46.524018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:46.524022 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:46.524040 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:46.524045 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:46.524099 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.524182 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.524212 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 17:44:46.524430 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:45455
--builtin_ntp_servers=127.9.187.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 17:44:46.524510 8403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.519860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:45455 (local address 127.9.187.193:49955)
0808 17:44:46.520062 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.520097 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:46.520578 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:46.520783 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:46.520786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:46.520795 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:46.521290 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.521295 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.521889 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.521889 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.522753 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.522756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.523104 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.523105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.523284 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.523887 (+ 603us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:44:46.523888 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:46.523917 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:44:46.523938 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:46.524105 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:46.524109 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:46.524112 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:46.524179 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:44:46.524288 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
I20260808 17:44:46.524914 8400 heartbeater.cc:347] Connected to a master server at 127.9.187.254:45455
I20260808 17:44:46.525017 8400 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:46.525204 8400 heartbeater.cc:511] Master 127.9.187.254:45455 requested a full tablet report, sending...
I20260808 17:44:46.525707 8111 ts_manager.cc:194] Registered new tserver with Master: 8fef29cb5adb42f095f0484654e2142a (127.9.187.193:32799)
I20260808 17:44:46.526546 8111 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.193:49955
W20260808 17:44:46.604424 8405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:46.604619 8405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:46.604640 8405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:46.605707 8405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:46.605739 8405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:46.605762 8405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:44:46.607041 8405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:45455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:46.607223 8405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:46.607461 8405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:46.612145 8411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:46.612131 8415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:46.612129 8412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:46.612290 8405 server_base.cc:1034] running on GCE node
I20260808 17:44:46.612519 8405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:46.612713 8405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:46.613858 8405 hybrid_clock.cc:648] HybridClock initialized: now 1786211086613846 us; error 28 us; skew 500 ppm
I20260808 17:44:46.615052 8405 webserver.cc:460] Webserver started at http://127.9.187.194:32959/ using document root <none> and password file <none>
I20260808 17:44:46.615278 8405 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:46.615324 8405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:46.615445 8405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:46.616437 8405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "27cd7440b756454ba1cf2aba5703c793"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "8359a03f47a6da547d768796b75d7da1"
server_key_iv: "35d6bbaa7ccb35effc7ecc982758b6ea"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.616778 8405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "27cd7440b756454ba1cf2aba5703c793"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "8359a03f47a6da547d768796b75d7da1"
server_key_iv: "35d6bbaa7ccb35effc7ecc982758b6ea"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.617956 8405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:44:46.618669 8423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.618808 8405 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.618886 8405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "27cd7440b756454ba1cf2aba5703c793"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "8359a03f47a6da547d768796b75d7da1"
server_key_iv: "35d6bbaa7ccb35effc7ecc982758b6ea"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.618952 8405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:46.639242 8405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:46.639515 8405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:46.639636 8405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:46.639842 8405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:46.640144 8405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:46.640178 8405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.640200 8405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:46.640223 8405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.645479 8405 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:45697
I20260808 17:44:46.645522 8613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:45697 every 8 connection(s)
I20260808 17:44:46.645810 8405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:44:46.649969 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 8405
I20260808 17:44:46.650072 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:44:46.650307 9967 external_mini_cluster.cc:1428] Setting key a9738a156d8cf07e575cadbc9d77578b
I20260808 17:44:46.650806 8193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.646487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:45571 (local address 127.9.187.254:45455)
0808 17:44:46.646552 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.646554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.646767 (+ 213us) server_negotiation.cc:407] Connection header received
0808 17:44:46.647264 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.647265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.647278 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.647331 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:46.647972 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.648468 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.649409 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.649619 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.649675 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.650517 (+ 842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:46.650519 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:46.650519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:46.650524 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:46.650542 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:46.650547 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:46.650605 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.650720 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.650746 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 17:44:46.651047 8620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.646475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:45455 (local address 127.9.187.194:45571)
0808 17:44:46.646656 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.646691 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:46.647166 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:46.647397 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:46.647400 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:46.647408 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:46.647887 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.647892 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.648549 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.648550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.649328 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.649331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.649688 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.649689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.649813 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.650370 (+ 557us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:44:46.650371 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:46.650412 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:44:46.650437 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:46.650624 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:46.650633 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:46.650636 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:46.650721 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 17:44:46.650830 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260808 17:44:46.651314 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:45455
--builtin_ntp_servers=127.9.187.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 17:44:46.651438 8616 heartbeater.cc:347] Connected to a master server at 127.9.187.254:45455
I20260808 17:44:46.651532 8616 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:46.651706 8616 heartbeater.cc:511] Master 127.9.187.254:45455 requested a full tablet report, sending...
I20260808 17:44:46.652041 8111 ts_manager.cc:194] Registered new tserver with Master: 27cd7440b756454ba1cf2aba5703c793 (127.9.187.194:45697)
I20260808 17:44:46.652395 8111 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.194:45571
W20260808 17:44:46.734515 8624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:46.734715 8624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:46.734736 8624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:46.735831 8624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:46.735877 8624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:46.735901 8624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:44:46.737183 8624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:45455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:46.737372 8624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:46.737635 8624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:46.742501 8630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:46.742604 8624 server_base.cc:1034] running on GCE node
W20260808 17:44:46.742568 8629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:46.742565 8632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:46.742939 8624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:46.743184 8624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:46.744321 8624 hybrid_clock.cc:648] HybridClock initialized: now 1786211086744301 us; error 32 us; skew 500 ppm
I20260808 17:44:46.745471 8624 webserver.cc:460] Webserver started at http://127.9.187.195:32775/ using document root <none> and password file <none>
I20260808 17:44:46.745712 8624 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:46.745765 8624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:46.745895 8624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:46.746978 8624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "2c169650dfab4f0b9b9c9c0036282a3d"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "7c0a8394f63b939b3eed9cc4f1932f2a"
server_key_iv: "36a6afe96d186b0deef8b16cb4799b70"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.747314 8624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "2c169650dfab4f0b9b9c9c0036282a3d"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "7c0a8394f63b939b3eed9cc4f1932f2a"
server_key_iv: "36a6afe96d186b0deef8b16cb4799b70"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.748492 8624 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:44:46.749141 8644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.749300 8624 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:44:46.749383 8624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "2c169650dfab4f0b9b9c9c0036282a3d"
format_stamp: "Formatted at 2026-08-08 17:44:46 on dist-test-slave-bqcl"
server_key: "7c0a8394f63b939b3eed9cc4f1932f2a"
server_key_iv: "36a6afe96d186b0deef8b16cb4799b70"
server_key_version: "encryptionkey@0"
I20260808 17:44:46.749449 8624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:46.759079 8624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:46.759330 8624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:46.759449 8624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:46.759654 8624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:46.759950 8624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:46.759984 8624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.760012 8624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:46.760036 8624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:46.765329 8624 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:35675
I20260808 17:44:46.765384 8831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:35675 every 8 connection(s)
I20260808 17:44:46.765672 8624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:44:46.766583 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 8624
I20260808 17:44:46.766691 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:44:46.766906 9967 external_mini_cluster.cc:1428] Setting key 5620a9bedc11b9b114c7b6eedbb90500
I20260808 17:44:46.770852 8193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.766345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:60979 (local address 127.9.187.254:45455)
0808 17:44:46.766416 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.766418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.766724 (+ 306us) server_negotiation.cc:407] Connection header received
0808 17:44:46.767346 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.767347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.767356 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.767390 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:46.768154 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.768642 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.769584 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.769804 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.769853 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.770589 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:46.770590 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:46.770591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:46.770594 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:46.770609 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:46.770612 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:46.770652 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.770767 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.770791 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 17:44:46.771054 8837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.766335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:45455 (local address 127.9.187.195:60979)
0808 17:44:46.766604 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.766643 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:46.767264 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:46.767461 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:46.767464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:46.767474 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:46.768085 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.768091 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.768726 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.768727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.769519 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.769521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.769864 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.769864 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.769975 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.770464 (+ 489us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:44:46.770464 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:46.770496 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:44:46.770519 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:46.770685 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:46.770692 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:46.770695 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:46.770765 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 17:44:46.770852 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":77,"threads_started":1}
I20260808 17:44:46.771448 8832 heartbeater.cc:347] Connected to a master server at 127.9.187.254:45455
I20260808 17:44:46.771534 8832 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:46.771734 8832 heartbeater.cc:511] Master 127.9.187.254:45455 requested a full tablet report, sending...
I20260808 17:44:46.772042 8111 ts_manager.cc:194] Registered new tserver with Master: 2c169650dfab4f0b9b9c9c0036282a3d (127.9.187.195:35675)
I20260808 17:44:46.772383 8111 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.195:60979
I20260808 17:44:46.778612 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:44:46.782693 8193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.779918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49314 (local address 127.9.187.254:45455)
0808 17:44:46.779961 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.779962 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.780075 (+ 113us) server_negotiation.cc:407] Connection header received
0808 17:44:46.780118 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.780119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.780129 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.780176 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:46.780314 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.780790 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.781488 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.781696 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.781749 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.782408 (+ 659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:46.782409 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:46.782409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:46.782414 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:46.782427 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:46.782431 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:46.782501 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.782606 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.782616 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:44:46.784348 8111 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49314:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:44:46.785909 8111 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:44:46.792090 8851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.788029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:45697 (local address 127.0.0.1:47766)
0808 17:44:46.788408 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.788454 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:46.788525 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:46.788828 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:46.788829 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:46.788831 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:46.788877 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.788879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.789795 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.789796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.790994 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.790997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.791816 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.791817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.791899 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.791913 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:44:46.791979 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 17:44:46.792022 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":52,"threads_started":1}
I20260808 17:44:46.792117 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.788254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47766 (local address 127.9.187.194:45697)
0808 17:44:46.788576 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.788580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.788590 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:44:46.788638 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.788640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.788656 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.788738 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:46.788955 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.789712 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.791065 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.791729 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.791803 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.791897 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.791993 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.792033 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":79,"threads_started":1}
I20260808 17:44:46.792476 8850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.788030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:32799 (local address 127.0.0.1:58022)
0808 17:44:46.788454 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.788463 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:46.788529 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:46.788798 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:46.788802 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:46.788804 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:46.788869 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.788871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.790247 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.790248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.791095 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.791097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.792277 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.792278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.792336 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.792339 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:46.792390 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:44:46.792422 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":6,"thread_start_us":86,"threads_started":1}
I20260808 17:44:46.792529 8854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.788221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58022 (local address 127.9.187.193:32799)
0808 17:44:46.788394 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.788399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.788536 (+ 137us) server_negotiation.cc:407] Connection header received
0808 17:44:46.788621 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.788623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.788639 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.788709 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:46.788956 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.790145 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.791162 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.791738 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.791806 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.791898 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.792410 (+ 512us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.792451 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
I20260808 17:44:46.792344 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.788036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:35675 (local address 127.0.0.1:59598)
0808 17:44:46.788628 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.788636 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:46.788688 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:46.788900 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:46.788901 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:46.788902 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:46.788934 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.788936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.790216 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.790217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.791298 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.791300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.792109 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.792110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.792179 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.792183 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:44:46.792229 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:44:46.792268 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":22,"thread_start_us":121,"threads_started":1}
I20260808 17:44:46.792891 8858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.788282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59598 (local address 127.9.187.195:35675)
0808 17:44:46.788484 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.788487 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.788709 (+ 222us) server_negotiation.cc:407] Connection header received
0808 17:44:46.788751 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.788753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.788767 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.788835 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:46.789002 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.790145 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.791373 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.792028 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.792095 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.792508 (+ 413us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.792770 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.792811 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":85,"threads_started":1}
I20260808 17:44:46.792833 8498 tablet_service.cc:1467] Processing CreateTablet for tablet c2cfdc610384474c97cf56d7221573d8 (DEFAULT_TABLE table=test-table [id=35837d1b6a0a419fbc5e57bcc62d2d45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:46.793213 8498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2cfdc610384474c97cf56d7221573d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:46.793507 8721 tablet_service.cc:1467] Processing CreateTablet for tablet c2cfdc610384474c97cf56d7221573d8 (DEFAULT_TABLE table=test-table [id=35837d1b6a0a419fbc5e57bcc62d2d45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:46.793817 8721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2cfdc610384474c97cf56d7221573d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:46.795943 8859 tablet_bootstrap.cc:492] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793: Bootstrap starting.
I20260808 17:44:46.796365 8861 tablet_bootstrap.cc:492] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d: Bootstrap starting.
I20260808 17:44:46.796558 8859 tablet_bootstrap.cc:654] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:46.796839 8859 log.cc:824] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:46.797013 8861 tablet_bootstrap.cc:654] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:46.797045 8302 tablet_service.cc:1467] Processing CreateTablet for tablet c2cfdc610384474c97cf56d7221573d8 (DEFAULT_TABLE table=test-table [id=35837d1b6a0a419fbc5e57bcc62d2d45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:46.797339 8861 log.cc:824] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:46.797381 8302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2cfdc610384474c97cf56d7221573d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:46.797806 8859 tablet_bootstrap.cc:492] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793: No bootstrap required, opened a new log
I20260808 17:44:46.797874 8859 ts_tablet_manager.cc:1397] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:44:46.798085 8861 tablet_bootstrap.cc:492] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d: No bootstrap required, opened a new log
I20260808 17:44:46.798188 8861 ts_tablet_manager.cc:1397] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:44:46.799715 8859 raft_consensus.cc:348] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fef29cb5adb42f095f0484654e2142a" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32799 } } peers { permanent_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35675 } } peers { permanent_uuid: "27cd7440b756454ba1cf2aba5703c793" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45697 } }
I20260808 17:44:46.799846 8859 raft_consensus.cc:374] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:46.799880 8859 raft_consensus.cc:729] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27cd7440b756454ba1cf2aba5703c793, State: Initialized, Role: FOLLOWER
I20260808 17:44:46.799989 8859 consensus_queue.cc:260] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fef29cb5adb42f095f0484654e2142a" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32799 } } peers { permanent_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35675 } } peers { permanent_uuid: "27cd7440b756454ba1cf2aba5703c793" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45697 } }
I20260808 17:44:46.800259 8859 ts_tablet_manager.cc:1428] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:44:46.800292 8616 heartbeater.cc:503] Master 127.9.187.254:45455 was elected leader, sending a full tablet report...
I20260808 17:44:46.800635 8871 tablet_bootstrap.cc:492] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a: Bootstrap starting.
I20260808 17:44:46.801360 8871 tablet_bootstrap.cc:654] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:46.801542 8861 raft_consensus.cc:348] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fef29cb5adb42f095f0484654e2142a" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32799 } } peers { permanent_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35675 } } peers { permanent_uuid: "27cd7440b756454ba1cf2aba5703c793" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45697 } }
I20260808 17:44:46.801646 8871 log.cc:824] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:46.801687 8861 raft_consensus.cc:374] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:46.801720 8861 raft_consensus.cc:729] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c169650dfab4f0b9b9c9c0036282a3d, State: Initialized, Role: FOLLOWER
I20260808 17:44:46.801831 8861 consensus_queue.cc:260] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fef29cb5adb42f095f0484654e2142a" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32799 } } peers { permanent_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35675 } } peers { permanent_uuid: "27cd7440b756454ba1cf2aba5703c793" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45697 } }
I20260808 17:44:46.802083 8861 ts_tablet_manager.cc:1428] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 17:44:46.802146 8832 heartbeater.cc:503] Master 127.9.187.254:45455 was elected leader, sending a full tablet report...
I20260808 17:44:46.802348 8871 tablet_bootstrap.cc:492] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a: No bootstrap required, opened a new log
I20260808 17:44:46.802423 8871 ts_tablet_manager.cc:1397] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:44:46.804173 8871 raft_consensus.cc:348] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fef29cb5adb42f095f0484654e2142a" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32799 } } peers { permanent_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35675 } } peers { permanent_uuid: "27cd7440b756454ba1cf2aba5703c793" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45697 } }
I20260808 17:44:46.804296 8871 raft_consensus.cc:374] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:46.804328 8871 raft_consensus.cc:729] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fef29cb5adb42f095f0484654e2142a, State: Initialized, Role: FOLLOWER
I20260808 17:44:46.804433 8871 consensus_queue.cc:260] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fef29cb5adb42f095f0484654e2142a" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32799 } } peers { permanent_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35675 } } peers { permanent_uuid: "27cd7440b756454ba1cf2aba5703c793" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45697 } }
I20260808 17:44:46.804641 8871 ts_tablet_manager.cc:1428] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:44:46.804720 8400 heartbeater.cc:503] Master 127.9.187.254:45455 was elected leader, sending a full tablet report...
I20260808 17:44:46.837132 8873 raft_consensus.cc:482] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:46.837288 8873 raft_consensus.cc:504] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fef29cb5adb42f095f0484654e2142a" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32799 } } peers { permanent_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35675 } } peers { permanent_uuid: "27cd7440b756454ba1cf2aba5703c793" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45697 } }
I20260808 17:44:46.837697 8873 leader_election.cc:288] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fef29cb5adb42f095f0484654e2142a (127.9.187.193:32799), 27cd7440b756454ba1cf2aba5703c793 (127.9.187.194:45697)
I20260808 17:44:46.840528 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.837909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:35533 (local address 127.9.187.194:45697)
0808 17:44:46.837953 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.837955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.837967 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:44:46.838002 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.838003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.838012 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.838079 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:46.838282 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.838805 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.839819 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.840222 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.840275 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.840283 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.840421 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.840454 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:44:46.840540 8837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.837841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:45697 (local address 127.9.187.195:35533)
0808 17:44:46.837894 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.837905 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:46.837946 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:46.838108 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:46.838110 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:46.838113 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:46.838211 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.838213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.838871 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.838872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.839739 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.839742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.840288 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.840289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.840357 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.840360 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:46.840417 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 17:44:46.840461 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 17:44:46.840741 8854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.837936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:46083 (local address 127.9.187.193:32799)
0808 17:44:46.837977 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.837979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.838112 (+ 133us) server_negotiation.cc:407] Connection header received
0808 17:44:46.838192 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.838193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.838206 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.838262 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:46.838428 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.839025 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.839993 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.840395 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.840455 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.840462 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.840649 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.840692 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:44:46.840926 8878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.837849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:32799 (local address 127.9.187.195:46083)
0808 17:44:46.838048 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.838058 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:46.838116 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:46.838297 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:46.838298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:46.838300 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:46.838361 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.838363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.839113 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.839114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.839912 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:46.839915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.840473 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.840474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:46.840552 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.840557 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:44:46.840815 (+ 258us) client_negotiation.cc:240] Negotiation successful
0808 17:44:46.840856 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":14,"thread_start_us":102,"threads_started":1}
I20260808 17:44:46.841150 8534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2cfdc610384474c97cf56d7221573d8" candidate_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27cd7440b756454ba1cf2aba5703c793" is_pre_election: true
I20260808 17:44:46.841284 8534 raft_consensus.cc:2454] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c169650dfab4f0b9b9c9c0036282a3d in term 0.
I20260808 17:44:46.841508 8652 leader_election.cc:302] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27cd7440b756454ba1cf2aba5703c793, 2c169650dfab4f0b9b9c9c0036282a3d; no voters:
I20260808 17:44:46.841570 8334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2cfdc610384474c97cf56d7221573d8" candidate_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fef29cb5adb42f095f0484654e2142a" is_pre_election: true
I20260808 17:44:46.841658 8873 raft_consensus.cc:2781] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:44:46.841717 8334 raft_consensus.cc:2454] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c169650dfab4f0b9b9c9c0036282a3d in term 0.
I20260808 17:44:46.841730 8873 raft_consensus.cc:482] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:44:46.841759 8873 raft_consensus.cc:3037] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:46.842517 8873 raft_consensus.cc:504] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fef29cb5adb42f095f0484654e2142a" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32799 } } peers { permanent_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35675 } } peers { permanent_uuid: "27cd7440b756454ba1cf2aba5703c793" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45697 } }
I20260808 17:44:46.842631 8873 leader_election.cc:288] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [CANDIDATE]: Term 1 election: Requested vote from peers 8fef29cb5adb42f095f0484654e2142a (127.9.187.193:32799), 27cd7440b756454ba1cf2aba5703c793 (127.9.187.194:45697)
I20260808 17:44:46.842782 8334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2cfdc610384474c97cf56d7221573d8" candidate_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fef29cb5adb42f095f0484654e2142a"
I20260808 17:44:46.842814 8534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2cfdc610384474c97cf56d7221573d8" candidate_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27cd7440b756454ba1cf2aba5703c793"
I20260808 17:44:46.842861 8334 raft_consensus.cc:3037] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:46.842876 8534 raft_consensus.cc:3037] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:46.843648 8334 raft_consensus.cc:2454] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c169650dfab4f0b9b9c9c0036282a3d in term 1.
I20260808 17:44:46.843684 8534 raft_consensus.cc:2454] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c169650dfab4f0b9b9c9c0036282a3d in term 1.
I20260808 17:44:46.843827 8653 leader_election.cc:302] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c169650dfab4f0b9b9c9c0036282a3d, 8fef29cb5adb42f095f0484654e2142a; no voters:
I20260808 17:44:46.843962 8873 raft_consensus.cc:2781] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:46.844132 8873 raft_consensus.cc:686] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 1 LEADER]: Becoming Leader. State: Replica: 2c169650dfab4f0b9b9c9c0036282a3d, State: Running, Role: LEADER
I20260808 17:44:46.844223 8873 consensus_queue.cc:237] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fef29cb5adb42f095f0484654e2142a" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32799 } } peers { permanent_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35675 } } peers { permanent_uuid: "27cd7440b756454ba1cf2aba5703c793" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45697 } }
I20260808 17:44:46.845048 8110 catalog_manager.cc:5495] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c169650dfab4f0b9b9c9c0036282a3d (127.9.187.195). New cstate: current_term: 1 leader_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fef29cb5adb42f095f0484654e2142a" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c169650dfab4f0b9b9c9c0036282a3d" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27cd7440b756454ba1cf2aba5703c793" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45697 } health_report { overall_health: UNKNOWN } } }
I20260808 17:44:46.850310 8858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.848115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59604 (local address 127.9.187.195:35675)
0808 17:44:46.848165 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:46.848167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:46.848174 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:44:46.848206 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:46.848207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:46.848222 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:46.848279 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:44:46.848394 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.848824 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.849521 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:46.849716 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:46.849766 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:46.849926 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:44:46.850019 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:44:46.850102 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:46.850216 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 17:44:46.850224 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:44:46.851878 8334 raft_consensus.cc:1261] T c2cfdc610384474c97cf56d7221573d8 P 8fef29cb5adb42f095f0484654e2142a [term 1 FOLLOWER]: Refusing update from remote peer 2c169650dfab4f0b9b9c9c0036282a3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:46.851903 8534 raft_consensus.cc:1261] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793 [term 1 FOLLOWER]: Refusing update from remote peer 2c169650dfab4f0b9b9c9c0036282a3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:46.852169 8873 consensus_queue.cc:1035] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fef29cb5adb42f095f0484654e2142a" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 32799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:46.852303 8880 consensus_queue.cc:1035] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27cd7440b756454ba1cf2aba5703c793" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:46.855189 8886 mvcc.cc:205] Tried to move back new op lower bound from 7316320611742982144 to 7316320611714588672. Current Snapshot: MvccSnapshot[applied={T|T < 7316320611742982144}]
I20260808 17:44:46.856719 8109 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:46.856804 8109 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:46.857481 8109 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c678ed0574994cc3b2b9f095cf6e5add: Sending DeleteTablet for 3 replicas of tablet c2cfdc610384474c97cf56d7221573d8
I20260808 17:44:46.857795 8721 tablet_service.cc:1514] Processing DeleteTablet for tablet c2cfdc610384474c97cf56d7221573d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:46 UTC) from {username='slave'} at 127.0.0.1:59598
I20260808 17:44:46.857865 8498 tablet_service.cc:1514] Processing DeleteTablet for tablet c2cfdc610384474c97cf56d7221573d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:46 UTC) from {username='slave'} at 127.0.0.1:47766
I20260808 17:44:46.857918 8302 tablet_service.cc:1514] Processing DeleteTablet for tablet c2cfdc610384474c97cf56d7221573d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:46 UTC) from {username='slave'} at 127.0.0.1:58022
I20260808 17:44:46.858070 8900 tablet_replica.cc:330] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793: stopping tablet replica
I20260808 17:44:46.858173 8900 raft_consensus.cc:2229] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:46.858274 8900 raft_consensus.cc:2258] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:46.858335 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 8208
I20260808 17:44:46.864365 8900 ts_tablet_manager.cc:1905] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:46.865908 8900 ts_tablet_manager.cc:1918] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:46.865998 8900 log.cc:1196] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/c2cfdc610384474c97cf56d7221573d8
I20260808 17:44:46.866281 8900 ts_tablet_manager.cc:1939] T c2cfdc610384474c97cf56d7221573d8 P 27cd7440b756454ba1cf2aba5703c793: Deleting consensus metadata
I20260808 17:44:46.866720 8080 catalog_manager.cc:4841] TS 27cd7440b756454ba1cf2aba5703c793 (127.9.187.194:45697): tablet c2cfdc610384474c97cf56d7221573d8 (table test-table [id=35837d1b6a0a419fbc5e57bcc62d2d45]) successfully deleted
I20260808 17:44:46.870059 8897 tablet_replica.cc:330] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d: stopping tablet replica
W20260808 17:44:46.870081 8081 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:32799 (error 108)
I20260808 17:44:46.870224 8897 raft_consensus.cc:2229] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:44:46.870288 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 8405
I20260808 17:44:46.870361 8897 raft_consensus.cc:2258] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:46.870653 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:46.870544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:32799 (local address 127.0.0.1:58038)
0808 17:44:46.870590 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:46.870620 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:32799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 17:44:46.870745 8081 catalog_manager.cc:4584] TS 8fef29cb5adb42f095f0484654e2142a (127.9.187.193:32799): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c2cfdc610384474c97cf56d7221573d8: Network error: Client connection negotiation failed: client connection to 127.9.187.193:32799: connect: Connection refused (error 111)
I20260808 17:44:46.873489 8897 ts_tablet_manager.cc:1905] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:46.875207 8897 ts_tablet_manager.cc:1918] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:46.875281 8897 log.cc:1196] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/c2cfdc610384474c97cf56d7221573d8
I20260808 17:44:46.875526 8897 ts_tablet_manager.cc:1939] T c2cfdc610384474c97cf56d7221573d8 P 2c169650dfab4f0b9b9c9c0036282a3d: Deleting consensus metadata
I20260808 17:44:46.876776 8079 catalog_manager.cc:4841] TS 2c169650dfab4f0b9b9c9c0036282a3d (127.9.187.195:35675): tablet c2cfdc610384474c97cf56d7221573d8 (table test-table [id=35837d1b6a0a419fbc5e57bcc62d2d45]) successfully deleted
I20260808 17:44:46.883797 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 8624
I20260808 17:44:46.897610 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 8053
2026-08-08T17:44:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (684 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:44:46 dist-test-slave-bqcl krb5kdc[8908](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:44:46 dist-test-slave-bqcl krb5kdc[8908](info): set up 2 sockets
Aug 08 17:44:46 dist-test-slave-bqcl krb5kdc[8908](info): commencing operation
krb5kdc: starting...
W20260808 17:44:48.031896 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:44:48 dist-test-slave-bqcl krb5kdc[8908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:44:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:44:48.144696 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:40983
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:40983
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:48.225425 8925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:48.225653 8925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:48.225677 8925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:48.226835 8925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:48.226876 8925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:48.226887 8925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:48.226912 8925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:48.226933 8925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:48.228353 8925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:40983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:40983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:48.228585 8925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:48.228789 8925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:44:48.233361 8925 server_base.cc:1034] running on GCE node
W20260808 17:44:48.233282 8940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:48.233314 8941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:48.233333 8943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:48.233770 8925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:48.234045 8925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:48.235181 8925 hybrid_clock.cc:648] HybridClock initialized: now 1786211088235177 us; error 40 us; skew 500 ppm
Aug 08 17:44:48 dist-test-slave-bqcl krb5kdc[8908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211088, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:48.237495 8925 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:44:48.237927 8925 webserver.cc:460] Webserver started at http://127.9.187.254:46721/ using document root <none> and password file <none>
I20260808 17:44:48.238178 8925 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:48.238229 8925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:48.238350 8925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:48.239311 8925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "1065a2763ca144e6aab7e8c31db78904"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "7f0d57a6ae8af9626699487aea531448"
server_key_iv: "b2763f8b739560bae7d7409563f475c8"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.239635 8925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "1065a2763ca144e6aab7e8c31db78904"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "7f0d57a6ae8af9626699487aea531448"
server_key_iv: "b2763f8b739560bae7d7409563f475c8"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.240801 8925 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:44:48.241420 8955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:48.241587 8925 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:44:48.241672 8925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "1065a2763ca144e6aab7e8c31db78904"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "7f0d57a6ae8af9626699487aea531448"
server_key_iv: "b2763f8b739560bae7d7409563f475c8"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.241732 8925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:48.250397 8925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:48.252022 8925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:48.252167 8925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:48.255946 8925 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:40983
I20260808 17:44:48.255975 9049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:40983 every 8 connection(s)
I20260808 17:44:48.256274 8925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:48.257045 9050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:48.259037 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 8925
I20260808 17:44:48.259150 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:48.259312 9967 external_mini_cluster.cc:1428] Setting key 55277d8c84a0d3484cb36250c0793e62
I20260808 17:44:48.259316 9050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904: Bootstrap starting.
I20260808 17:44:48.259909 9050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:48.260192 9050 log.cc:824] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:48.260870 9050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904: No bootstrap required, opened a new log
I20260808 17:44:48.262935 9050 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1065a2763ca144e6aab7e8c31db78904" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40983 } }
I20260808 17:44:48.263093 9050 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:48.263124 9050 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1065a2763ca144e6aab7e8c31db78904, State: Initialized, Role: FOLLOWER
I20260808 17:44:48.263254 9050 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1065a2763ca144e6aab7e8c31db78904" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40983 } }
I20260808 17:44:48.263339 9050 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:48.263363 9050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:48.263412 9050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:48.263916 9050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1065a2763ca144e6aab7e8c31db78904" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40983 } }
I20260808 17:44:48.264029 9050 leader_election.cc:302] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1065a2763ca144e6aab7e8c31db78904; no voters:
I20260808 17:44:48.264181 9050 leader_election.cc:288] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:48.264223 9059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:48.264334 9059 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [term 1 LEADER]: Becoming Leader. State: Replica: 1065a2763ca144e6aab7e8c31db78904, State: Running, Role: LEADER
I20260808 17:44:48.264403 9059 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1065a2763ca144e6aab7e8c31db78904" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40983 } }
I20260808 17:44:48.264437 9050 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 17:44:48 dist-test-slave-bqcl krb5kdc[8908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:48.266098 9062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1065a2763ca144e6aab7e8c31db78904" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1065a2763ca144e6aab7e8c31db78904" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40983 } } }
I20260808 17:44:48.266227 9062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:48.266506 9063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1065a2763ca144e6aab7e8c31db78904. Latest consensus state: current_term: 1 leader_uuid: "1065a2763ca144e6aab7e8c31db78904" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1065a2763ca144e6aab7e8c31db78904" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 40983 } } }
I20260808 17:44:48.266570 9063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:48.266764 9082 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:48.267627 9082 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:48.268980 9082 catalog_manager.cc:1347] Generated new cluster ID: c6d4163b2bfa4a87a562c629fb6afafa
I20260808 17:44:48.269032 9082 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:48.269603 9055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.259797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41424 (local address 127.9.187.254:40983)
0808 17:44:48.259948 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:48.259956 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:48.259983 (+ 27us) server_negotiation.cc:407] Connection header received
0808 17:44:48.260431 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:48.260438 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:48.260481 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:48.260596 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:48.261325 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.262261 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.263273 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.263773 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.263850 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.266337 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:48.266341 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:48.266342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:48.266354 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:48.268205 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:48.268521 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:48.268533 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:48.268534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:48.268642 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:48.268817 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:48.268818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:48.268818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:48.269085 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:48.269238 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:48.269313 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 17:44:48.269440 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":59,"threads_started":1}
I20260808 17:44:48.278925 9082 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:48.279428 9082 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:48.283977 9082 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904: Generated new TSK 0
I20260808 17:44:48.284125 9082 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.187.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
Entry for principal kudu/127.9.187.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab.
I20260808 17:44:48.312981 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40983
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:48.421670 9095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:48.421885 9095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:48.421916 9095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:48.423122 9095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:48.423166 9095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:48.423202 9095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:44:48.424649 9095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.193.keytab
--principal=kudu/127.9.187.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:48.424893 9095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:48.425120 9095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:48.430150 9102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:48.430195 9106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:48.430195 9104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:48.430431 9095 server_base.cc:1034] running on GCE node
I20260808 17:44:48.430634 9095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:48.430881 9095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:48.432052 9095 hybrid_clock.cc:648] HybridClock initialized: now 1786211088432032 us; error 33 us; skew 500 ppm
Aug 08 17:44:48 dist-test-slave-bqcl krb5kdc[8908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211088, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:48.434435 9095 init.cc:377] Logged in from keytab as kudu/127.9.187.193@KRBTEST.COM (short username kudu)
I20260808 17:44:48.434872 9095 webserver.cc:460] Webserver started at http://127.9.187.193:38021/ using document root <none> and password file <none>
I20260808 17:44:48.435087 9095 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:48.435137 9095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:48.435259 9095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:48.436275 9095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "5282220edc44414f8ddc6e7ea8ac6415"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "e055eb700cc518f7132ef69e25491229"
server_key_iv: "47b38cc6cefdc06398757cbc3a66546d"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.436625 9095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "5282220edc44414f8ddc6e7ea8ac6415"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "e055eb700cc518f7132ef69e25491229"
server_key_iv: "47b38cc6cefdc06398757cbc3a66546d"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.437824 9095 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:44:48.438553 9116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:48.438701 9095 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:48.438784 9095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "5282220edc44414f8ddc6e7ea8ac6415"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "e055eb700cc518f7132ef69e25491229"
server_key_iv: "47b38cc6cefdc06398757cbc3a66546d"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.438845 9095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:48.451295 9095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:48.452901 9095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:48.453037 9095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:48.453241 9095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:48.453526 9095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:48.453559 9095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:48.453588 9095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:48.453605 9095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:48.459128 9095 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:35197
I20260808 17:44:48.459183 9288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:35197 every 8 connection(s)
I20260808 17:44:48.459460 9095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:44:48 dist-test-slave-bqcl krb5kdc[8908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211088, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.193@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:48.468151 9055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.460191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:40453 (local address 127.9.187.254:40983)
0808 17:44:48.460254 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:48.460257 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:48.460425 (+ 168us) server_negotiation.cc:407] Connection header received
0808 17:44:48.460921 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:48.460922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:48.460935 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:48.460986 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:48.461903 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.462445 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.463403 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.463597 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.463651 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.465699 (+ 2048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:48.465701 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:48.465701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:48.465709 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:48.466928 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:48.467283 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:48.467285 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:48.467285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:48.467339 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:48.467545 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:48.467546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:48.467546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:48.467656 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:48.467713 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:48.467968 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 17:44:48.468058 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 17:44:48.468297 9291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.460115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40983 (local address 127.9.187.193:40453)
0808 17:44:48.460304 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:48.460346 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:48.460824 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:48.461054 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:48.461058 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:48.461614 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:48.461807 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.461812 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.462528 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.462529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.463317 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.463319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.463664 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.463665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.463788 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.464255 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:48.464263 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:48.465611 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:48.466998 (+ 1387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:48.467005 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:48.467007 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:48.467219 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:48.467391 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:48.467392 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:48.467392 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:48.467490 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:48.467719 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:48.467725 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:48.467854 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 17:44:48.467939 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 17:44:48.468090 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":84,"threads_started":1}
I20260808 17:44:48.468751 9289 heartbeater.cc:347] Connected to a master server at 127.9.187.254:40983
I20260808 17:44:48.468837 9289 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:48.468971 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 9095
I20260808 17:44:48.469008 9289 heartbeater.cc:511] Master 127.9.187.254:40983 requested a full tablet report, sending...
I20260808 17:44:48.469079 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:44:48.469274 9967 external_mini_cluster.cc:1428] Setting key ca7fc15a26ef32dd3904dcb40f633803
I20260808 17:44:48.469534 8990 ts_manager.cc:194] Registered new tserver with Master: 5282220edc44414f8ddc6e7ea8ac6415 (127.9.187.193:35197)
I20260808 17:44:48.470201 8990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.193@KRBTEST.COM'} at 127.9.187.193:40453
WARNING: no policy specified for kudu/127.9.187.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
Entry for principal kudu/127.9.187.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab.
I20260808 17:44:48.494400 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40983
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:48.574204 9295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:48.574391 9295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:48.574411 9295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:48.575466 9295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:48.575503 9295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:48.575526 9295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:44:48.576882 9295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.194.keytab
--principal=kudu/127.9.187.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:48.577062 9295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:48.577224 9295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:48.581871 9300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:48.581883 9301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:48.581938 9303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:48.581987 9295 server_base.cc:1034] running on GCE node
I20260808 17:44:48.582302 9295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:48.582531 9295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:48.583664 9295 hybrid_clock.cc:648] HybridClock initialized: now 1786211088583652 us; error 32 us; skew 500 ppm
Aug 08 17:44:48 dist-test-slave-bqcl krb5kdc[8908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211088, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:48.586011 9295 init.cc:377] Logged in from keytab as kudu/127.9.187.194@KRBTEST.COM (short username kudu)
I20260808 17:44:48.586429 9295 webserver.cc:460] Webserver started at http://127.9.187.194:44859/ using document root <none> and password file <none>
I20260808 17:44:48.586615 9295 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:48.586652 9295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:48.586743 9295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:48.587638 9295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "fbff8c9d77b64b89bf76d0a6fcba6409"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "d431c57b5b8701d6cd9459f2fc41e854"
server_key_iv: "6ac22eda15f883ec54f9173db4d7e37c"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.587921 9295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "fbff8c9d77b64b89bf76d0a6fcba6409"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "d431c57b5b8701d6cd9459f2fc41e854"
server_key_iv: "6ac22eda15f883ec54f9173db4d7e37c"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.589099 9295 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:44:48.589701 9312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:48.589859 9295 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:44:48.589942 9295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "fbff8c9d77b64b89bf76d0a6fcba6409"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "d431c57b5b8701d6cd9459f2fc41e854"
server_key_iv: "6ac22eda15f883ec54f9173db4d7e37c"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.589994 9295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:48.599047 9295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:48.601008 9295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:48.601114 9295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:48.601274 9295 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:48.601508 9295 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:48.601537 9295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:48.601557 9295 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:48.601580 9295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:48.606824 9295 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:41333
I20260808 17:44:48.606884 9484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:41333 every 8 connection(s)
I20260808 17:44:48.607132 9295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:44:48.608994 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 9295
I20260808 17:44:48.609118 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:44:48.609304 9967 external_mini_cluster.cc:1428] Setting key fe1bef5171ad2bfce7be73d8d66bc27e
Aug 08 17:44:48 dist-test-slave-bqcl krb5kdc[8908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211088, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.194@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:48.616081 9055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.607735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:50143 (local address 127.9.187.254:40983)
0808 17:44:48.607775 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:48.607778 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:48.607939 (+ 161us) server_negotiation.cc:407] Connection header received
0808 17:44:48.608404 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:48.608406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:48.608417 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:48.608469 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:48.609535 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.610084 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.611091 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.611337 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.611401 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.613426 (+ 2025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:48.613427 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:48.613427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:48.613435 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:48.614869 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:48.615229 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:48.615230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:48.615230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:48.615291 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:48.615488 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:48.615489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:48.615489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:48.615626 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:48.615703 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:48.615909 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 17:44:48.615989 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:44:48.616140 9488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.607702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40983 (local address 127.9.187.194:50143)
0808 17:44:48.607828 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:48.607866 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:48.608310 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:48.608532 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:48.608536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:48.609180 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:48.609451 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.609457 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.610204 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.610205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.611005 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.611008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.611412 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.611413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.611512 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.611929 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:48.611938 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:48.613342 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:48.614957 (+ 1615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:48.614963 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:48.614964 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:48.615166 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:48.615346 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:48.615347 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:48.615347 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:48.615433 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:48.615681 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:48.615684 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:48.615790 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 17:44:48.615868 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 17:44:48.615983 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":61,"threads_started":1}
I20260808 17:44:48.616781 9486 heartbeater.cc:347] Connected to a master server at 127.9.187.254:40983
I20260808 17:44:48.616873 9486 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:48.617040 9486 heartbeater.cc:511] Master 127.9.187.254:40983 requested a full tablet report, sending...
I20260808 17:44:48.617394 8990 ts_manager.cc:194] Registered new tserver with Master: fbff8c9d77b64b89bf76d0a6fcba6409 (127.9.187.194:41333)
I20260808 17:44:48.617744 8990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.194@KRBTEST.COM'} at 127.9.187.194:50143
WARNING: no policy specified for kudu/127.9.187.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
Entry for principal kudu/127.9.187.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab.
I20260808 17:44:48.635013 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40983
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:38271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:48.718973 9493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:48.719177 9493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:48.719216 9493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:48.720306 9493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:48.720345 9493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:48.720379 9493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:44:48.721762 9493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:38271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.195.keytab
--principal=kudu/127.9.187.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:40983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:48.721982 9493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:48.722229 9493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:48.726888 9503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:48.726899 9498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:48.726907 9505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:48.727223 9493 server_base.cc:1034] running on GCE node
I20260808 17:44:48.727424 9493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:48.727654 9493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:48.728806 9493 hybrid_clock.cc:648] HybridClock initialized: now 1786211088728793 us; error 31 us; skew 500 ppm
Aug 08 17:44:48 dist-test-slave-bqcl krb5kdc[8908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211088, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:48.731426 9493 init.cc:377] Logged in from keytab as kudu/127.9.187.195@KRBTEST.COM (short username kudu)
I20260808 17:44:48.731863 9493 webserver.cc:460] Webserver started at http://127.9.187.195:44947/ using document root <none> and password file <none>
I20260808 17:44:48.732052 9493 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:48.732098 9493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:48.732224 9493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:48.733189 9493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "f0548356a0984b2d85b0dcbe367a3f28"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "44ef95a014f2df6776757747330ba2b2"
server_key_iv: "2842b82e970df88817f3e237358923e5"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.733510 9493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "f0548356a0984b2d85b0dcbe367a3f28"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "44ef95a014f2df6776757747330ba2b2"
server_key_iv: "2842b82e970df88817f3e237358923e5"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.734812 9493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:44:48.735510 9515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:48.735678 9493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:48.735767 9493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "f0548356a0984b2d85b0dcbe367a3f28"
format_stamp: "Formatted at 2026-08-08 17:44:48 on dist-test-slave-bqcl"
server_key: "44ef95a014f2df6776757747330ba2b2"
server_key_iv: "2842b82e970df88817f3e237358923e5"
server_key_version: "encryptionkey@0"
I20260808 17:44:48.735826 9493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:48.748624 9493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:48.750241 9493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:48.750366 9493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:48.750554 9493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:48.750828 9493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:48.750861 9493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:48.750888 9493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:48.750913 9493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:48.756173 9493 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:38811
I20260808 17:44:48.756234 9700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:38811 every 8 connection(s)
I20260808 17:44:48.756493 9493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:44:48 dist-test-slave-bqcl krb5kdc[8908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211088, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.195@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:44:48.764681 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 9493
I20260808 17:44:48.764822 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:44:48.765029 9967 external_mini_cluster.cc:1428] Setting key 6ec5bf8a3ed8f54d5c5f5d6d19218898
I20260808 17:44:48.765091 9055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.757124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:53735 (local address 127.9.187.254:40983)
0808 17:44:48.757168 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:48.757170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:48.757353 (+ 183us) server_negotiation.cc:407] Connection header received
0808 17:44:48.757794 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:48.757795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:48.757804 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:48.757856 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:48.758788 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.759289 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.760218 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.760419 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.760477 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.762385 (+ 1908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:48.762387 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:48.762387 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:48.762394 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:48.763647 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:48.764023 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:48.764025 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:48.764025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:48.764103 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:48.764344 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:48.764345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:48.764346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:48.764475 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:48.764550 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:48.764913 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 17:44:48.764998 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:44:48.765586 9707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.757092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:40983 (local address 127.9.187.195:53735)
0808 17:44:48.757237 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:48.757278 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:48.757721 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:48.757908 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:48.757911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:48.758494 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:48.758676 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.758680 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.759361 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.759362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.760130 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.760132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.760482 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.760483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.760572 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.761012 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:44:48.761020 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:48.762299 (+ 1279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:48.763728 (+ 1429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:48.763734 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:48.763736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:48.763940 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:48.764160 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:44:48.764161 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:44:48.764161 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:44:48.764252 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:44:48.764552 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:48.764557 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:48.764731 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 17:44:48.765226 (+ 495us) client_negotiation.cc:240] Negotiation successful
0808 17:44:48.765386 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260808 17:44:48.765969 9702 heartbeater.cc:347] Connected to a master server at 127.9.187.254:40983
I20260808 17:44:48.766070 9702 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:48.766273 9702 heartbeater.cc:511] Master 127.9.187.254:40983 requested a full tablet report, sending...
I20260808 17:44:48.766661 8989 ts_manager.cc:194] Registered new tserver with Master: f0548356a0984b2d85b0dcbe367a3f28 (127.9.187.195:38811)
I20260808 17:44:48.767014 8989 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.187.195@KRBTEST.COM'} at 127.9.187.195:53735
I20260808 17:44:48.776611 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:44:48.783061 9055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.777803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41428 (local address 127.9.187.254:40983)
0808 17:44:48.777853 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:48.777855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:48.777947 (+ 92us) server_negotiation.cc:407] Connection header received
0808 17:44:48.778007 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:48.778008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:48.778018 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:48.778062 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:48.778623 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.779087 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.779787 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.779984 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.780034 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.781056 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:48.781057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:48.781057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:48.781064 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:48.782050 (+ 986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:48.782361 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:48.782362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:48.782363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:48.782417 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:48.782576 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:48.782577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:48.782577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:48.782719 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:48.782808 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:48.782904 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 17:44:48.782978 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:44:48.784435 8989 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:44:48.786012 8989 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:44:48.792254 9726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.788136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:35197 (local address 127.0.0.1:51824)
0808 17:44:48.788442 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:48.788486 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:48.788556 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:48.788765 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:48.788768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:48.788770 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:48.788855 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.788857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.790021 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.790022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.791187 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.791190 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.791963 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.791964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.792053 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.792067 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:44:48.792130 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 17:44:48.792184 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":75,"threads_started":1}
I20260808 17:44:48.792268 9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.788254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51824 (local address 127.9.187.193:35197)
0808 17:44:48.788620 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:48.788624 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:48.788633 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:44:48.788670 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:48.788672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:48.788686 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:48.788753 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:48.789192 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.789932 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.791274 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.791889 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.791950 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.792010 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:48.792153 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 17:44:48.792194 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":84,"threads_started":1}
I20260808 17:44:48.792683 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.788337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:38811 (local address 127.0.0.1:41872)
0808 17:44:48.788979 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:48.788986 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:48.789025 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:48.789222 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:48.789223 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:48.789226 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:48.789279 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.789280 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.790501 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.790502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.791505 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.791507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.792430 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.792431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.792498 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.792503 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:44:48.792547 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 17:44:48.792585 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"mutex_wait_us":26,"thread_start_us":60,"threads_started":1}
I20260808 17:44:48.792757 9732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.788330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42514 (local address 127.9.187.194:41333)
0808 17:44:48.788528 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:48.788532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:48.788915 (+ 383us) server_negotiation.cc:407] Connection header received
0808 17:44:48.788969 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:48.788971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:48.788985 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:48.789064 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:48.789248 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.790389 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.791548 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.792273 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.792341 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.792392 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:48.792644 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 17:44:48.792689 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":84,"threads_started":1}
I20260808 17:44:48.792915 9735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.788421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41872 (local address 127.9.187.195:38811)
0808 17:44:48.788567 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:48.788572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:48.789078 (+ 506us) server_negotiation.cc:407] Connection header received
0808 17:44:48.789121 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:48.789124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:48.789140 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:48.789214 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:48.789347 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.790406 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.791589 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.792273 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.792341 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.792392 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:48.792795 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 17:44:48.792838 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
I20260808 17:44:48.792695 9728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:48.788136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:41333 (local address 127.0.0.1:42514)
0808 17:44:48.788853 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:48.788862 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:48.788911 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:48.789057 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:48.789058 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:48.789115 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:48.789159 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.789161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.790509 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.790510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.791462 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:48.791465 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:48.792432 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:48.792432 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:48.792498 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:48.792501 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:48.792547 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:44:48.792585 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"mutex_wait_us":37,"thread_start_us":64,"threads_started":1}
I20260808 17:44:48.793339 9185 tablet_service.cc:1467] Processing CreateTablet for tablet 91a1ffa436ea41e193d8d7fe8eb7fc45 (DEFAULT_TABLE table=test-table [id=38923da6c73a4b5aa1f9aa771f8a5659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:48.793462 9589 tablet_service.cc:1467] Processing CreateTablet for tablet 91a1ffa436ea41e193d8d7fe8eb7fc45 (DEFAULT_TABLE table=test-table [id=38923da6c73a4b5aa1f9aa771f8a5659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:48.793730 9185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a1ffa436ea41e193d8d7fe8eb7fc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:48.793730 9589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a1ffa436ea41e193d8d7fe8eb7fc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:48.793870 9383 tablet_service.cc:1467] Processing CreateTablet for tablet 91a1ffa436ea41e193d8d7fe8eb7fc45 (DEFAULT_TABLE table=test-table [id=38923da6c73a4b5aa1f9aa771f8a5659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:48.794214 9383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a1ffa436ea41e193d8d7fe8eb7fc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:48.796721 9737 tablet_bootstrap.cc:492] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: Bootstrap starting.
I20260808 17:44:48.797046 9739 tablet_bootstrap.cc:492] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415: Bootstrap starting.
I20260808 17:44:48.797374 9737 tablet_bootstrap.cc:654] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:48.797596 9739 tablet_bootstrap.cc:654] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:48.797868 9737 log.cc:824] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:48.798072 9739 log.cc:824] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:48.798270 9738 tablet_bootstrap.cc:492] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: Bootstrap starting.
I20260808 17:44:48.798763 9739 tablet_bootstrap.cc:492] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415: No bootstrap required, opened a new log
I20260808 17:44:48.798784 9738 tablet_bootstrap.cc:654] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:48.798818 9739 ts_tablet_manager.cc:1397] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:44:48.799182 9738 log.cc:824] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:48.799719 9737 tablet_bootstrap.cc:492] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: No bootstrap required, opened a new log
I20260808 17:44:48.799785 9737 ts_tablet_manager.cc:1397] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 17:44:48.799909 9738 tablet_bootstrap.cc:492] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: No bootstrap required, opened a new log
I20260808 17:44:48.799975 9738 ts_tablet_manager.cc:1397] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:44:48.800431 9739 raft_consensus.cc:348] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41333 } } peers { permanent_uuid: "5282220edc44414f8ddc6e7ea8ac6415" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 35197 } } peers { permanent_uuid: "f0548356a0984b2d85b0dcbe367a3f28" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38811 } }
I20260808 17:44:48.800621 9739 raft_consensus.cc:374] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:48.800669 9739 raft_consensus.cc:729] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5282220edc44414f8ddc6e7ea8ac6415, State: Initialized, Role: FOLLOWER
I20260808 17:44:48.800784 9739 consensus_queue.cc:260] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41333 } } peers { permanent_uuid: "5282220edc44414f8ddc6e7ea8ac6415" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 35197 } } peers { permanent_uuid: "f0548356a0984b2d85b0dcbe367a3f28" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38811 } }
I20260808 17:44:48.801061 9739 ts_tablet_manager.cc:1428] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:48.801087 9289 heartbeater.cc:503] Master 127.9.187.254:40983 was elected leader, sending a full tablet report...
I20260808 17:44:48.801359 9737 raft_consensus.cc:348] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41333 } } peers { permanent_uuid: "5282220edc44414f8ddc6e7ea8ac6415" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 35197 } } peers { permanent_uuid: "f0548356a0984b2d85b0dcbe367a3f28" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38811 } }
I20260808 17:44:48.801548 9737 raft_consensus.cc:374] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:48.801586 9737 raft_consensus.cc:729] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbff8c9d77b64b89bf76d0a6fcba6409, State: Initialized, Role: FOLLOWER
I20260808 17:44:48.801708 9737 consensus_queue.cc:260] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41333 } } peers { permanent_uuid: "5282220edc44414f8ddc6e7ea8ac6415" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 35197 } } peers { permanent_uuid: "f0548356a0984b2d85b0dcbe367a3f28" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38811 } }
I20260808 17:44:48.801987 9737 ts_tablet_manager.cc:1428] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:48.801904 9738 raft_consensus.cc:348] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41333 } } peers { permanent_uuid: "5282220edc44414f8ddc6e7ea8ac6415" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 35197 } } peers { permanent_uuid: "f0548356a0984b2d85b0dcbe367a3f28" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38811 } }
I20260808 17:44:48.801999 9486 heartbeater.cc:503] Master 127.9.187.254:40983 was elected leader, sending a full tablet report...
I20260808 17:44:48.802059 9738 raft_consensus.cc:374] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:48.802091 9738 raft_consensus.cc:729] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0548356a0984b2d85b0dcbe367a3f28, State: Initialized, Role: FOLLOWER
I20260808 17:44:48.802238 9738 consensus_queue.cc:260] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41333 } } peers { permanent_uuid: "5282220edc44414f8ddc6e7ea8ac6415" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 35197 } } peers { permanent_uuid: "f0548356a0984b2d85b0dcbe367a3f28" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38811 } }
I20260808 17:44:48.802503 9738 ts_tablet_manager.cc:1428] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:44:48.802523 9702 heartbeater.cc:503] Master 127.9.187.254:40983 was elected leader, sending a full tablet report...
W20260808 17:44:48.857668 9487 tablet.cc:2369] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:44:48.960145 9290 tablet.cc:2369] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:44:49.007025 9706 tablet.cc:2369] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:44:49.226269 9743 raft_consensus.cc:482] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:49.226393 9743 raft_consensus.cc:504] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41333 } } peers { permanent_uuid: "5282220edc44414f8ddc6e7ea8ac6415" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 35197 } } peers { permanent_uuid: "f0548356a0984b2d85b0dcbe367a3f28" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38811 } }
I20260808 17:44:49.226787 9743 leader_election.cc:288] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbff8c9d77b64b89bf76d0a6fcba6409 (127.9.187.194:41333), f0548356a0984b2d85b0dcbe367a3f28 (127.9.187.195:38811)
I20260808 17:44:49.230896 9749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:49.226940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:41333 (local address 127.9.187.193:38511)
0808 17:44:49.228027 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:49.228038 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:49.228129 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:49.228341 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:49.228341 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:49.228343 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:49.228426 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:49.228428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.229171 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.229172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:49.230029 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:49.230032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.230626 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.230627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:49.230708 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:49.230713 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:44:49.230767 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 17:44:49.230805 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1071,"thread_start_us":1035,"threads_started":1}
I20260808 17:44:49.230891 9732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:49.226997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:38511 (local address 127.9.187.194:41333)
0808 17:44:49.227046 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:49.227048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:49.228100 (+ 1052us) server_negotiation.cc:407] Connection header received
0808 17:44:49.228221 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:49.228222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:49.228236 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:49.228286 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:49.228516 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.229097 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.230142 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.230543 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.230598 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:49.230608 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:49.230781 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 17:44:49.230820 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:44:49.231119 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:49.226957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:38811 (local address 127.9.187.193:59733)
0808 17:44:49.228174 (+ 1217us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:49.228185 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:49.228259 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:49.228621 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:49.228622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:49.228624 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:49.228708 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:49.228711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.229447 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.229448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:49.230238 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:49.230241 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.230834 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.230835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:49.230909 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:49.230913 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:44:49.231003 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 17:44:49.231041 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1202,"thread_start_us":1137,"threads_started":1}
I20260808 17:44:49.231123 9735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:49.227312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:59733 (local address 127.9.187.195:38811)
0808 17:44:49.227357 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:49.227359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:49.228261 (+ 902us) server_negotiation.cc:407] Connection header received
0808 17:44:49.228503 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:49.228504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:49.228514 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:49.228570 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:49.228794 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.229368 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.230308 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.230762 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.230822 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:49.230830 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:49.231022 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 17:44:49.231065 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:44:49.231458 9414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a1ffa436ea41e193d8d7fe8eb7fc45" candidate_uuid: "5282220edc44414f8ddc6e7ea8ac6415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" is_pre_election: true
I20260808 17:44:49.231487 9615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a1ffa436ea41e193d8d7fe8eb7fc45" candidate_uuid: "5282220edc44414f8ddc6e7ea8ac6415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0548356a0984b2d85b0dcbe367a3f28" is_pre_election: true
I20260808 17:44:49.231621 9414 raft_consensus.cc:2454] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5282220edc44414f8ddc6e7ea8ac6415 in term 0.
I20260808 17:44:49.231621 9615 raft_consensus.cc:2454] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5282220edc44414f8ddc6e7ea8ac6415 in term 0.
I20260808 17:44:49.231863 9121 leader_election.cc:302] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5282220edc44414f8ddc6e7ea8ac6415, f0548356a0984b2d85b0dcbe367a3f28; no voters:
I20260808 17:44:49.232004 9743 raft_consensus.cc:2781] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:44:49.232082 9743 raft_consensus.cc:482] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:44:49.232098 9743 raft_consensus.cc:3037] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:49.232771 9743 raft_consensus.cc:504] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41333 } } peers { permanent_uuid: "5282220edc44414f8ddc6e7ea8ac6415" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 35197 } } peers { permanent_uuid: "f0548356a0984b2d85b0dcbe367a3f28" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38811 } }
I20260808 17:44:49.232888 9743 leader_election.cc:288] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [CANDIDATE]: Term 1 election: Requested vote from peers fbff8c9d77b64b89bf76d0a6fcba6409 (127.9.187.194:41333), f0548356a0984b2d85b0dcbe367a3f28 (127.9.187.195:38811)
I20260808 17:44:49.233042 9414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a1ffa436ea41e193d8d7fe8eb7fc45" candidate_uuid: "5282220edc44414f8ddc6e7ea8ac6415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409"
I20260808 17:44:49.233088 9615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a1ffa436ea41e193d8d7fe8eb7fc45" candidate_uuid: "5282220edc44414f8ddc6e7ea8ac6415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0548356a0984b2d85b0dcbe367a3f28"
I20260808 17:44:49.233125 9414 raft_consensus.cc:3037] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:49.233150 9615 raft_consensus.cc:3037] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:49.233961 9414 raft_consensus.cc:2454] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5282220edc44414f8ddc6e7ea8ac6415 in term 1.
I20260808 17:44:49.233961 9615 raft_consensus.cc:2454] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5282220edc44414f8ddc6e7ea8ac6415 in term 1.
I20260808 17:44:49.234174 9122 leader_election.cc:302] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5282220edc44414f8ddc6e7ea8ac6415, fbff8c9d77b64b89bf76d0a6fcba6409; no voters:
I20260808 17:44:49.234290 9743 raft_consensus.cc:2781] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:49.234433 9743 raft_consensus.cc:686] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [term 1 LEADER]: Becoming Leader. State: Replica: 5282220edc44414f8ddc6e7ea8ac6415, State: Running, Role: LEADER
I20260808 17:44:49.234524 9743 consensus_queue.cc:237] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41333 } } peers { permanent_uuid: "5282220edc44414f8ddc6e7ea8ac6415" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 35197 } } peers { permanent_uuid: "f0548356a0984b2d85b0dcbe367a3f28" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38811 } }
I20260808 17:44:49.235291 8990 catalog_manager.cc:5495] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5282220edc44414f8ddc6e7ea8ac6415 (127.9.187.193). New cstate: current_term: 1 leader_uuid: "5282220edc44414f8ddc6e7ea8ac6415" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5282220edc44414f8ddc6e7ea8ac6415" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0548356a0984b2d85b0dcbe367a3f28" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38811 } health_report { overall_health: UNKNOWN } } }
I20260808 17:44:49.338616 9756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:49.336267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51826 (local address 127.9.187.193:35197)
0808 17:44:49.336362 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:49.336364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:49.336411 (+ 47us) server_negotiation.cc:407] Connection header received
0808 17:44:49.336484 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:49.336485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:49.336505 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:49.336572 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:44:49.336668 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.337138 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.337878 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.338094 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.338171 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:49.338339 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:44:49.338463 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:44:49.338521 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:49.338534 (+ 13us) server_negotiation.cc:299] Negotiation successful
0808 17:44:49.338550 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75,"thread_start_us":52,"threads_started":1}
I20260808 17:44:49.340400 9414 raft_consensus.cc:1261] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409 [term 1 FOLLOWER]: Refusing update from remote peer 5282220edc44414f8ddc6e7ea8ac6415: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:49.340411 9615 raft_consensus.cc:1261] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28 [term 1 FOLLOWER]: Refusing update from remote peer 5282220edc44414f8ddc6e7ea8ac6415: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:49.340759 9751 consensus_queue.cc:1035] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbff8c9d77b64b89bf76d0a6fcba6409" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 41333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:49.340881 9743 consensus_queue.cc:1035] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P 5282220edc44414f8ddc6e7ea8ac6415 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0548356a0984b2d85b0dcbe367a3f28" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:49.343243 9763 mvcc.cc:205] Tried to move back new op lower bound from 7316320621935525888 to 7316320621505130496. Current Snapshot: MvccSnapshot[applied={T|T < 7316320621935525888}]
I20260808 17:44:49.343529 9762 mvcc.cc:205] Tried to move back new op lower bound from 7316320621935525888 to 7316320621505130496. Current Snapshot: MvccSnapshot[applied={T|T < 7316320621935525888}]
I20260808 17:44:49.345096 8989 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:49.345175 8989 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:49.345865 8989 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1065a2763ca144e6aab7e8c31db78904: Sending DeleteTablet for 3 replicas of tablet 91a1ffa436ea41e193d8d7fe8eb7fc45
I20260808 17:44:49.346167 9185 tablet_service.cc:1514] Processing DeleteTablet for tablet 91a1ffa436ea41e193d8d7fe8eb7fc45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:49 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:51824
I20260808 17:44:49.346215 9383 tablet_service.cc:1514] Processing DeleteTablet for tablet 91a1ffa436ea41e193d8d7fe8eb7fc45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:49 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:42514
I20260808 17:44:49.346376 9589 tablet_service.cc:1514] Processing DeleteTablet for tablet 91a1ffa436ea41e193d8d7fe8eb7fc45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:49 UTC) from {username='kudu', principal='kudu/127.9.187.254@KRBTEST.COM'} at 127.0.0.1:41872
I20260808 17:44:49.346570 9776 tablet_replica.cc:330] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: stopping tablet replica
I20260808 17:44:49.346661 9776 raft_consensus.cc:2229] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:49.346657 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 9095
I20260808 17:44:49.375658 9775 tablet_replica.cc:330] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: stopping tablet replica
I20260808 17:44:49.375654 9776 raft_consensus.cc:2258] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:49.375821 9775 raft_consensus.cc:2229] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:49.375931 9775 raft_consensus.cc:2258] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:49.376770 9775 ts_tablet_manager.cc:1905] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:49.376876 9776 ts_tablet_manager.cc:1905] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:49.378269 9775 ts_tablet_manager.cc:1918] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:49.378343 9775 log.cc:1196] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/91a1ffa436ea41e193d8d7fe8eb7fc45
I20260808 17:44:49.378405 9776 ts_tablet_manager.cc:1918] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:49.378480 9776 log.cc:1196] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/91a1ffa436ea41e193d8d7fe8eb7fc45
I20260808 17:44:49.378607 9775 ts_tablet_manager.cc:1939] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P fbff8c9d77b64b89bf76d0a6fcba6409: Deleting consensus metadata
I20260808 17:44:49.378717 9776 ts_tablet_manager.cc:1939] T 91a1ffa436ea41e193d8d7fe8eb7fc45 P f0548356a0984b2d85b0dcbe367a3f28: Deleting consensus metadata
I20260808 17:44:49.379068 8964 catalog_manager.cc:4841] TS fbff8c9d77b64b89bf76d0a6fcba6409 (127.9.187.194:41333): tablet 91a1ffa436ea41e193d8d7fe8eb7fc45 (table test-table [id=38923da6c73a4b5aa1f9aa771f8a5659]) successfully deleted
I20260808 17:44:49.379251 8962 catalog_manager.cc:4841] TS f0548356a0984b2d85b0dcbe367a3f28 (127.9.187.195:38811): tablet 91a1ffa436ea41e193d8d7fe8eb7fc45 (table test-table [id=38923da6c73a4b5aa1f9aa771f8a5659]) successfully deleted
W20260808 17:44:49.381101 8962 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:35197 (error 108)
I20260808 17:44:49.381587 9780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:49.381431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:35197 (local address 127.0.0.1:51828)
0808 17:44:49.381515 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:49.381553 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:35197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68,"thread_start_us":42,"threads_started":1}
I20260808 17:44:49.381628 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 9295
W20260808 17:44:49.381711 8962 catalog_manager.cc:4584] TS 5282220edc44414f8ddc6e7ea8ac6415 (127.9.187.193:35197): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 91a1ffa436ea41e193d8d7fe8eb7fc45: Network error: Client connection negotiation failed: client connection to 127.9.187.193:35197: connect: Connection refused (error 111)
I20260808 17:44:49.390987 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 9493
I20260808 17:44:49.400544 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 8925
2026-08-08T17:44:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2505 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T17:44:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:49Z Disabled control of system clock
I20260808 17:44:49.432201 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:44491
--webserver_interface=127.9.187.254
--webserver_port=0
--builtin_ntp_servers=127.9.187.212:45211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:44491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:44:49.516945 9785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:49.517163 9785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:49.517190 9785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:49.518355 9785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:49.518396 9785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:49.518414 9785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:49.518429 9785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:49.518445 9785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:49.519789 9785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:44491
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:44491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:49.520031 9785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:49.520299 9785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:49.524884 9794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:49.524967 9785 server_base.cc:1034] running on GCE node
W20260808 17:44:49.525068 9796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:49.524893 9793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:49.525406 9785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:49.525707 9785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:49.526845 9785 hybrid_clock.cc:648] HybridClock initialized: now 1786211089526832 us; error 30 us; skew 500 ppm
I20260808 17:44:49.528046 9785 webserver.cc:460] Webserver started at http://127.9.187.254:46321/ using document root <none> and password file <none>
I20260808 17:44:49.528266 9785 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:49.528314 9785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:49.528438 9785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:49.529498 9785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "0f2145430e1448ddbb665883af6caaca"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "3895013a3710b9461ac758846cf66a0b"
server_key_iv: "b1ea938d1511b50e281ad69038c32916"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.529839 9785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "0f2145430e1448ddbb665883af6caaca"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "3895013a3710b9461ac758846cf66a0b"
server_key_iv: "b1ea938d1511b50e281ad69038c32916"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.531095 9785 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:44:49.531735 9813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:49.531908 9785 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:49.531993 9785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "0f2145430e1448ddbb665883af6caaca"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "3895013a3710b9461ac758846cf66a0b"
server_key_iv: "b1ea938d1511b50e281ad69038c32916"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.532052 9785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:49.545007 9785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:49.545307 9785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:49.545431 9785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:49.549209 9785 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:44491
I20260808 17:44:49.549250 9894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:44491 every 8 connection(s)
I20260808 17:44:49.549557 9785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:49.550542 9895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:49.552783 9895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca: Bootstrap starting.
I20260808 17:44:49.553361 9895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:49.553627 9895 log.cc:824] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:49.554291 9895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca: No bootstrap required, opened a new log
I20260808 17:44:49.555831 9895 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2145430e1448ddbb665883af6caaca" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44491 } }
I20260808 17:44:49.555967 9895 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:49.556000 9895 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f2145430e1448ddbb665883af6caaca, State: Initialized, Role: FOLLOWER
I20260808 17:44:49.556139 9895 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2145430e1448ddbb665883af6caaca" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44491 } }
I20260808 17:44:49.556223 9895 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:49.556254 9895 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:49.556303 9895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:49.556314 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 9785
I20260808 17:44:49.556403 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:49.556612 9967 external_mini_cluster.cc:1428] Setting key 12bf2b101d3a936c30ed72ae46dc4021
I20260808 17:44:49.556866 9895 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2145430e1448ddbb665883af6caaca" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44491 } }
I20260808 17:44:49.556978 9895 leader_election.cc:302] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f2145430e1448ddbb665883af6caaca; no voters:
I20260808 17:44:49.557152 9895 leader_election.cc:288] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:49.557255 9902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:49.557420 9902 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [term 1 LEADER]: Becoming Leader. State: Replica: 0f2145430e1448ddbb665883af6caaca, State: Running, Role: LEADER
I20260808 17:44:49.557418 9895 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:49.557557 9902 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2145430e1448ddbb665883af6caaca" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44491 } }
I20260808 17:44:49.558378 9907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f2145430e1448ddbb665883af6caaca. Latest consensus state: current_term: 1 leader_uuid: "0f2145430e1448ddbb665883af6caaca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2145430e1448ddbb665883af6caaca" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44491 } } }
I20260808 17:44:49.558475 9907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:49.558729 9925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:49.558773 9904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f2145430e1448ddbb665883af6caaca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2145430e1448ddbb665883af6caaca" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44491 } } }
I20260808 17:44:49.558854 9904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:49.559222 9925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:49.560773 9925 catalog_manager.cc:1347] Generated new cluster ID: 8abdbf1b4dbc4ca596e86360b62c62ce
I20260808 17:44:49.560827 9925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:49.562928 9903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:49.557088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45194 (local address 127.9.187.254:44491)
0808 17:44:49.557332 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:49.557341 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:49.557377 (+ 36us) server_negotiation.cc:407] Connection header received
0808 17:44:49.557495 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:49.557502 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:49.557572 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:49.557716 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:49.557994 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.560129 (+ 2135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.561045 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.561477 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.561597 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:49.562294 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:49.562298 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:49.562299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:49.562461 (+ 162us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:49.562494 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:49.562504 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:49.562570 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:49.562640 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 17:44:49.562719 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":100,"threads_started":1}
I20260808 17:44:49.579262 9925 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:49.580016 9925 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:49.587590 9925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca: Generated new TSK 0
I20260808 17:44:49.587809 9925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:44:49.594280 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.193:0
--local_ip_for_outbound_sockets=127.9.187.193
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44491
--builtin_ntp_servers=127.9.187.212:45211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:44:49.678784 9937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:49.679009 9937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:49.679044 9937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:49.680209 9937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:49.680255 9937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:49.680291 9937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.193
I20260808 17:44:49.682253 9937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.187.193
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.193
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:49.682526 9937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:49.682881 9937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:49.688567 9948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:49.688580 9953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:49.688587 9949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:49.688647 9937 server_base.cc:1034] running on GCE node
I20260808 17:44:49.689002 9937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:49.689231 9937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:49.690354 9937 hybrid_clock.cc:648] HybridClock initialized: now 1786211089690344 us; error 27 us; skew 500 ppm
I20260808 17:44:49.691617 9937 webserver.cc:460] Webserver started at http://127.9.187.193:35613/ using document root <none> and password file <none>
I20260808 17:44:49.691850 9937 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:49.691902 9937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:49.692031 9937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:49.693055 9937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/data/instance:
uuid: "8d36c51eeb194849b1630beea77aeb63"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "a5729e5186e1e31f2bd935f699dd4535"
server_key_iv: "a599fe768c68cf412405e5e136e8e4b7"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.693392 9937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance:
uuid: "8d36c51eeb194849b1630beea77aeb63"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "a5729e5186e1e31f2bd935f699dd4535"
server_key_iv: "a599fe768c68cf412405e5e136e8e4b7"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.694622 9937 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:44:49.695245 9963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:49.695392 9937 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:49.695473 9937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/wal
uuid: "8d36c51eeb194849b1630beea77aeb63"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "a5729e5186e1e31f2bd935f699dd4535"
server_key_iv: "a599fe768c68cf412405e5e136e8e4b7"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.695533 9937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:49.729768 9937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:49.730072 9937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:49.730235 9937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:49.730458 9937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:49.730790 9937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:49.730856 9937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:49.730893 9937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:49.730917 9937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:49.736325 9937 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.193:40777
I20260808 17:44:49.736399 10152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.193:40777 every 8 connection(s)
I20260808 17:44:49.736691 9937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/data/info.pb
I20260808 17:44:49.740499 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 9937
I20260808 17:44:49.740617 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-0/wal/instance
I20260808 17:44:49.740852 9967 external_mini_cluster.cc:1428] Setting key 8f58b47baccbc93501f31fdcb3f76f1f
I20260808 17:44:49.741741 9903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:49.737379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.193:36667 (local address 127.9.187.254:44491)
0808 17:44:49.737464 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:49.737466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:49.737677 (+ 211us) server_negotiation.cc:407] Connection header received
0808 17:44:49.738194 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:49.738196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:49.738209 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:49.738259 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:49.738911 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.739390 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.740318 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.740492 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.740534 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:49.741473 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:49.741475 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:49.741475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:49.741480 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:49.741497 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:49.741501 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:49.741555 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:49.741648 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 17:44:49.741674 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 17:44:49.741890 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.194:0
--local_ip_for_outbound_sockets=127.9.187.194
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44491
--builtin_ntp_servers=127.9.187.212:45211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 17:44:49.742002 10158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:49.737353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:44491 (local address 127.9.187.193:36667)
0808 17:44:49.737555 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:49.737591 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:49.738082 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:49.738317 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:49.738321 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:49.738329 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:49.738845 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:49.738850 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.739450 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.739451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:49.740252 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:49.740255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.740588 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.740590 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:49.740761 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:49.741334 (+ 573us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:44:49.741335 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:49.741364 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:44:49.741387 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:49.741566 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:49.741571 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:49.741574 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:49.741651 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 17:44:49.741764 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
I20260808 17:44:49.742537 10153 heartbeater.cc:347] Connected to a master server at 127.9.187.254:44491
I20260808 17:44:49.742620 10153 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:49.742789 10153 heartbeater.cc:511] Master 127.9.187.254:44491 requested a full tablet report, sending...
I20260808 17:44:49.743257 9837 ts_manager.cc:194] Registered new tserver with Master: 8d36c51eeb194849b1630beea77aeb63 (127.9.187.193:40777)
I20260808 17:44:49.743854 9837 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.193:36667
W20260808 17:44:49.835517 10159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:49.835716 10159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:49.835734 10159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:49.836848 10159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:49.836889 10159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:49.836916 10159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.194
I20260808 17:44:49.838281 10159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.187.194
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.194
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:49.838485 10159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:49.838757 10159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:49.843480 10176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:49.843505 10167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:49.843518 10171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:49.843681 10159 server_base.cc:1034] running on GCE node
I20260808 17:44:49.843891 10159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:49.844141 10159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:49.845294 10159 hybrid_clock.cc:648] HybridClock initialized: now 1786211089845276 us; error 28 us; skew 500 ppm
I20260808 17:44:49.846545 10159 webserver.cc:460] Webserver started at http://127.9.187.194:40607/ using document root <none> and password file <none>
I20260808 17:44:49.846767 10159 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:49.846818 10159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:49.846944 10159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:49.847926 10159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/data/instance:
uuid: "f5112ec6f20b48a995fc16da59d9774b"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "e8d72547d712220ef0bd42debb840909"
server_key_iv: "e6d2f0c22ef92421e8466d0474e483a6"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.848260 10159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance:
uuid: "f5112ec6f20b48a995fc16da59d9774b"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "e8d72547d712220ef0bd42debb840909"
server_key_iv: "e6d2f0c22ef92421e8466d0474e483a6"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.849427 10159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:44:49.850042 10185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:49.850203 10159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:49.850284 10159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/wal
uuid: "f5112ec6f20b48a995fc16da59d9774b"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "e8d72547d712220ef0bd42debb840909"
server_key_iv: "e6d2f0c22ef92421e8466d0474e483a6"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.850350 10159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:49.866250 10159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:49.866513 10159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:49.866638 10159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:49.866843 10159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:49.867139 10159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:49.867174 10159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:49.867202 10159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:49.867226 10159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:49.872540 10159 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.194:34587
I20260808 17:44:49.872602 10368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.194:34587 every 8 connection(s)
I20260808 17:44:49.872877 10159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/data/info.pb
I20260808 17:44:49.877436 9903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:49.873554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.194:56957 (local address 127.9.187.254:44491)
0808 17:44:49.873599 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:49.873601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:49.873787 (+ 186us) server_negotiation.cc:407] Connection header received
0808 17:44:49.874310 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:49.874311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:49.874321 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:49.874357 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:49.874954 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.875436 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.876333 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.876529 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.876578 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:49.877259 (+ 681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:49.877260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:49.877260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:49.877264 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:49.877273 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:49.877276 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:49.877307 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:49.877360 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 17:44:49.877378 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:44:49.877599 10372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:49.873505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:44491 (local address 127.9.187.194:56957)
0808 17:44:49.873691 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:49.873729 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:49.874216 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:49.874417 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:49.874421 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:49.874428 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:49.874892 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:49.874896 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.875496 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.875496 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:49.876258 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:49.876260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:49.876588 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:49.876588 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:49.876689 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:49.877148 (+ 459us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:44:49.877148 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:49.877176 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:44:49.877198 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:49.877309 (+ 111us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:49.877311 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:49.877313 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:44:49.877356 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:44:49.877427 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260808 17:44:49.878021 10369 heartbeater.cc:347] Connected to a master server at 127.9.187.254:44491
I20260808 17:44:49.878104 10369 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:49.878294 10369 heartbeater.cc:511] Master 127.9.187.254:44491 requested a full tablet report, sending...
I20260808 17:44:49.878636 9837 ts_manager.cc:194] Registered new tserver with Master: f5112ec6f20b48a995fc16da59d9774b (127.9.187.194:34587)
I20260808 17:44:49.878954 9837 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.194:56957
I20260808 17:44:49.879776 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 10159
I20260808 17:44:49.879858 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/wal/instance
I20260808 17:44:49.880024 9967 external_mini_cluster.cc:1428] Setting key c2fd0f6dfd380824da9768f491ae2323
I20260808 17:44:49.880812 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.187.195:0
--local_ip_for_outbound_sockets=127.9.187.195
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44491
--builtin_ntp_servers=127.9.187.212:45211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:44:49.961563 10373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:49.961751 10373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:49.961779 10373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:49.962867 10373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:49.962904 10373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:49.962936 10373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.187.195
I20260808 17:44:49.964196 10373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:45211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.187.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.187.195
--webserver_port=0
--tserver_master_addrs=127.9.187.254:44491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.187.195
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:49.964406 10373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:49.964675 10373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:49.969383 10381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:49.969369 10386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:49.969383 10382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:49.969786 10373 server_base.cc:1034] running on GCE node
I20260808 17:44:49.969975 10373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:49.970237 10373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:49.971371 10373 hybrid_clock.cc:648] HybridClock initialized: now 1786211089971355 us; error 30 us; skew 500 ppm
I20260808 17:44:49.972544 10373 webserver.cc:460] Webserver started at http://127.9.187.195:37005/ using document root <none> and password file <none>
I20260808 17:44:49.972783 10373 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:49.972828 10373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:49.972954 10373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:49.973939 10373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/data/instance:
uuid: "9c2d48939b9144e180601994af7bcc4a"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "d2fb06669d14b9879df9986376e6f70b"
server_key_iv: "dcdf2048de978af57fb3ff6d2a37ba59"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.974285 10373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance:
uuid: "9c2d48939b9144e180601994af7bcc4a"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "d2fb06669d14b9879df9986376e6f70b"
server_key_iv: "dcdf2048de978af57fb3ff6d2a37ba59"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.975440 10373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:44:49.976068 10395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:49.976210 10373 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:44:49.976293 10373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/wal
uuid: "9c2d48939b9144e180601994af7bcc4a"
format_stamp: "Formatted at 2026-08-08 17:44:49 on dist-test-slave-bqcl"
server_key: "d2fb06669d14b9879df9986376e6f70b"
server_key_iv: "dcdf2048de978af57fb3ff6d2a37ba59"
server_key_version: "encryptionkey@0"
I20260808 17:44:49.976358 10373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:49.999954 10373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:50.000273 10373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:50.000411 10373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:50.000648 10373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:44:50.000990 10373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:44:50.001026 10373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:50.001055 10373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:44:50.001075 10373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:50.006457 10373 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.195:37075
I20260808 17:44:50.006548 10587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.195:37075 every 8 connection(s)
I20260808 17:44:50.006870 10373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/data/info.pb
I20260808 17:44:50.011978 9903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.007601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:59033 (local address 127.9.187.254:44491)
0808 17:44:50.007653 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:50.007654 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:50.007895 (+ 241us) server_negotiation.cc:407] Connection header received
0808 17:44:50.008413 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:50.008414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:50.008427 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:50.008476 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:50.009180 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.009671 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.010671 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.010867 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.010922 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.011717 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:50.011718 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:50.011719 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:50.011723 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:50.011740 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:50.011744 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:50.011786 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:50.011862 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 17:44:50.011894 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:44:50.012180 10590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.007575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:44491 (local address 127.9.187.195:59033)
0808 17:44:50.007777 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:50.007812 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:50.008309 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:50.008561 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:50.008566 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:50.008583 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:44:50.009088 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.009093 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.009761 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.009762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.010588 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.010591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.010939 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.010940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.011081 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.011582 (+ 501us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:44:50.011583 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:44:50.011613 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:44:50.011637 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:44:50.011792 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:44:50.011797 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:44:50.011800 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:50.011861 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 17:44:50.011964 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
I20260808 17:44:50.012673 10588 heartbeater.cc:347] Connected to a master server at 127.9.187.254:44491
I20260808 17:44:50.012758 10588 heartbeater.cc:464] Registering TS with master...
I20260808 17:44:50.012930 10588 heartbeater.cc:511] Master 127.9.187.254:44491 requested a full tablet report, sending...
I20260808 17:44:50.013293 9837 ts_manager.cc:194] Registered new tserver with Master: 9c2d48939b9144e180601994af7bcc4a (127.9.187.195:37075)
I20260808 17:44:50.013628 9837 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.187.195:59033
I20260808 17:44:50.016837 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 10373
I20260808 17:44:50.016937 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/wal/instance
I20260808 17:44:50.017089 9967 external_mini_cluster.cc:1428] Setting key f8d12c4cb73e93adb7d3b2495cccdd21
I20260808 17:44:50.017899 9967 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:44:50.021893 9903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.019235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45200 (local address 127.9.187.254:44491)
0808 17:44:50.019283 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:50.019285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:50.019399 (+ 114us) server_negotiation.cc:407] Connection header received
0808 17:44:50.019462 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:50.019463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:50.019475 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:50.019517 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:50.019662 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.020114 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.020838 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.021018 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.021068 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.021670 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:50.021672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:50.021672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:50.021676 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:50.021691 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:50.021695 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:50.021738 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:50.021787 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 17:44:50.021813 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:44:50.023376 9837 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45200:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:44:50.024897 9837 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:44:50.031050 10608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.027162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59050 (local address 127.9.187.195:37075)
0808 17:44:50.027307 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:50.027310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:50.027318 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:50.027350 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:50.027353 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:50.027364 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:50.027459 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:50.027572 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.028401 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.029904 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.030649 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.030726 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.030807 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:50.030927 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 17:44:50.030967 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":79,"threads_started":1}
I20260808 17:44:50.031106 10603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.026840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.195:37075 (local address 127.0.0.1:59050)
0808 17:44:50.027000 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:50.027044 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:50.027120 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:50.027459 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:50.027459 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:50.027461 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:50.027499 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.027500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.028475 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.028476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.029807 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.029810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.030732 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.030733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.030815 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.030833 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 17:44:50.030903 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 17:44:50.030959 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":24,"thread_start_us":59,"threads_started":1}
I20260808 17:44:50.031107 10601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.026841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:34587 (local address 127.0.0.1:60798)
0808 17:44:50.027134 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:50.027143 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:50.027181 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:50.027429 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:50.027432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:50.027434 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:50.027499 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.027500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.029225 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.029226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.030177 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.030181 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.030837 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.030838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.030889 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.030892 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:44:50.030920 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 17:44:50.030959 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":11,"thread_start_us":93,"threads_started":1}
I20260808 17:44:50.031219 10607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.027150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53196 (local address 127.9.187.193:40777)
0808 17:44:50.027589 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:50.027593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:50.027603 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:44:50.027638 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:50.027640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:50.027676 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:50.027748 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:50.027866 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.028678 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.029905 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.030648 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.030716 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.030807 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:50.031091 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 17:44:50.031134 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":88,"threads_started":1}
I20260808 17:44:50.031311 10606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.027037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:40777 (local address 127.0.0.1:53196)
0808 17:44:50.027322 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:50.027332 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:50.027377 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:50.027746 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:50.027747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:50.027749 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:50.027785 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.027786 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.028770 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.028771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.029822 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.029823 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.030842 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.030843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.030908 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.030913 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:44:50.030962 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 17:44:50.031005 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":2,"thread_start_us":67,"threads_started":1}
I20260808 17:44:50.031442 10605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.026936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60798 (local address 127.9.187.194:34587)
0808 17:44:50.027259 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:50.027264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:50.027274 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:44:50.027312 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:50.027314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:50.027330 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:50.027410 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:50.028484 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.029145 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.030242 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.030739 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.031130 (+ 391us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.031296 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:50.031326 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 17:44:50.031364 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":103,"threads_started":1}
I20260808 17:44:50.032116 10263 tablet_service.cc:1467] Processing CreateTablet for tablet 5c68973c5bbb468ba5e66d9c39be5cde (DEFAULT_TABLE table=test-table [id=998f79affdee49aa84e9cedfd95287de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:50.032116 10045 tablet_service.cc:1467] Processing CreateTablet for tablet 5c68973c5bbb468ba5e66d9c39be5cde (DEFAULT_TABLE table=test-table [id=998f79affdee49aa84e9cedfd95287de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:50.032320 10471 tablet_service.cc:1467] Processing CreateTablet for tablet 5c68973c5bbb468ba5e66d9c39be5cde (DEFAULT_TABLE table=test-table [id=998f79affdee49aa84e9cedfd95287de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:44:50.032488 10045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c68973c5bbb468ba5e66d9c39be5cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:50.032488 10263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c68973c5bbb468ba5e66d9c39be5cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:50.032650 10471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c68973c5bbb468ba5e66d9c39be5cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:50.035248 10609 tablet_bootstrap.cc:492] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a: Bootstrap starting.
I20260808 17:44:50.035746 10610 tablet_bootstrap.cc:492] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63: Bootstrap starting.
I20260808 17:44:50.036015 10609 tablet_bootstrap.cc:654] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:50.036331 10609 log.cc:824] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:50.036392 10610 tablet_bootstrap.cc:654] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:50.036674 10610 log.cc:824] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:50.036979 10611 tablet_bootstrap.cc:492] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: Bootstrap starting.
I20260808 17:44:50.037081 10609 tablet_bootstrap.cc:492] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a: No bootstrap required, opened a new log
I20260808 17:44:50.037143 10609 ts_tablet_manager.cc:1397] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:44:50.037330 10610 tablet_bootstrap.cc:492] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63: No bootstrap required, opened a new log
I20260808 17:44:50.037391 10610 ts_tablet_manager.cc:1397] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:44:50.037575 10611 tablet_bootstrap.cc:654] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:50.037886 10611 log.cc:824] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:50.038686 10611 tablet_bootstrap.cc:492] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: No bootstrap required, opened a new log
I20260808 17:44:50.038805 10611 ts_tablet_manager.cc:1397] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:44:50.039265 10609 raft_consensus.cc:348] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5112ec6f20b48a995fc16da59d9774b" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34587 } } peers { permanent_uuid: "9c2d48939b9144e180601994af7bcc4a" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37075 } } peers { permanent_uuid: "8d36c51eeb194849b1630beea77aeb63" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40777 } }
I20260808 17:44:50.039397 10609 raft_consensus.cc:374] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:50.039428 10609 raft_consensus.cc:729] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c2d48939b9144e180601994af7bcc4a, State: Initialized, Role: FOLLOWER
I20260808 17:44:50.039561 10609 consensus_queue.cc:260] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5112ec6f20b48a995fc16da59d9774b" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34587 } } peers { permanent_uuid: "9c2d48939b9144e180601994af7bcc4a" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37075 } } peers { permanent_uuid: "8d36c51eeb194849b1630beea77aeb63" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40777 } }
I20260808 17:44:50.039803 10609 ts_tablet_manager.cc:1428] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:44:50.039740 10610 raft_consensus.cc:348] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5112ec6f20b48a995fc16da59d9774b" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34587 } } peers { permanent_uuid: "9c2d48939b9144e180601994af7bcc4a" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37075 } } peers { permanent_uuid: "8d36c51eeb194849b1630beea77aeb63" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40777 } }
I20260808 17:44:50.039898 10610 raft_consensus.cc:374] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:50.039930 10610 raft_consensus.cc:729] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d36c51eeb194849b1630beea77aeb63, State: Initialized, Role: FOLLOWER
I20260808 17:44:50.039928 10588 heartbeater.cc:503] Master 127.9.187.254:44491 was elected leader, sending a full tablet report...
I20260808 17:44:50.040041 10610 consensus_queue.cc:260] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5112ec6f20b48a995fc16da59d9774b" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34587 } } peers { permanent_uuid: "9c2d48939b9144e180601994af7bcc4a" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37075 } } peers { permanent_uuid: "8d36c51eeb194849b1630beea77aeb63" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40777 } }
I20260808 17:44:50.040297 10610 ts_tablet_manager.cc:1428] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 17:44:50.040424 10153 heartbeater.cc:503] Master 127.9.187.254:44491 was elected leader, sending a full tablet report...
I20260808 17:44:50.041215 10611 raft_consensus.cc:348] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5112ec6f20b48a995fc16da59d9774b" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34587 } } peers { permanent_uuid: "9c2d48939b9144e180601994af7bcc4a" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37075 } } peers { permanent_uuid: "8d36c51eeb194849b1630beea77aeb63" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40777 } }
I20260808 17:44:50.041375 10611 raft_consensus.cc:374] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:50.041421 10611 raft_consensus.cc:729] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5112ec6f20b48a995fc16da59d9774b, State: Initialized, Role: FOLLOWER
I20260808 17:44:50.041513 10611 consensus_queue.cc:260] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5112ec6f20b48a995fc16da59d9774b" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34587 } } peers { permanent_uuid: "9c2d48939b9144e180601994af7bcc4a" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37075 } } peers { permanent_uuid: "8d36c51eeb194849b1630beea77aeb63" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40777 } }
I20260808 17:44:50.041723 10611 ts_tablet_manager.cc:1428] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:44:50.041796 10369 heartbeater.cc:503] Master 127.9.187.254:44491 was elected leader, sending a full tablet report...
W20260808 17:44:50.123418 10370 tablet.cc:2369] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:44:50.169080 10620 raft_consensus.cc:482] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:44:50.169219 10620 raft_consensus.cc:504] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5112ec6f20b48a995fc16da59d9774b" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34587 } } peers { permanent_uuid: "9c2d48939b9144e180601994af7bcc4a" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37075 } } peers { permanent_uuid: "8d36c51eeb194849b1630beea77aeb63" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40777 } }
I20260808 17:44:50.169615 10620 leader_election.cc:288] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5112ec6f20b48a995fc16da59d9774b (127.9.187.194:34587), 8d36c51eeb194849b1630beea77aeb63 (127.9.187.193:40777)
I20260808 17:44:50.173561 10607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.170018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:57915 (local address 127.9.187.193:40777)
0808 17:44:50.170075 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:50.170077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:50.170223 (+ 146us) server_negotiation.cc:407] Connection header received
0808 17:44:50.170289 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:50.170289 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:50.170299 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:50.170339 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:50.170495 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.171171 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.172650 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.173199 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.173267 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.173275 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:50.173452 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 17:44:50.173488 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:44:50.173561 10605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.169885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.187.195:37555 (local address 127.9.187.194:34587)
0808 17:44:50.169992 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:50.169994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:50.170003 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:44:50.170029 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:50.170030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:50.170039 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:50.170086 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:44:50.170390 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.171154 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.172647 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.173209 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.173268 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.173275 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:50.173452 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 17:44:50.173488 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 17:44:50.173594 10590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.169801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.194:34587 (local address 127.9.187.195:37555)
0808 17:44:50.169863 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:50.169877 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:50.169928 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:50.170150 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:50.170151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:50.170153 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:50.170230 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.170232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.171241 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.171241 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.172564 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.172567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.173284 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.173285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.173379 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.173383 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:44:50.173442 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:44:50.173526 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":64}
I20260808 17:44:50.173600 10626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.169921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:40777 (local address 127.9.187.195:57915)
0808 17:44:50.170148 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:50.170158 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:44:50.170222 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:44:50.170355 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:44:50.170356 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:44:50.170358 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:44:50.170416 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.170418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.171236 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.171237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.172564 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:44:50.172567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.173284 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.173285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:44:50.173379 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.173383 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:44:50.173442 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:44:50.173494 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":73,"thread_start_us":120,"threads_started":1}
I20260808 17:44:50.173972 10077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c68973c5bbb468ba5e66d9c39be5cde" candidate_uuid: "9c2d48939b9144e180601994af7bcc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d36c51eeb194849b1630beea77aeb63" is_pre_election: true
I20260808 17:44:50.173974 10294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c68973c5bbb468ba5e66d9c39be5cde" candidate_uuid: "9c2d48939b9144e180601994af7bcc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5112ec6f20b48a995fc16da59d9774b" is_pre_election: true
I20260808 17:44:50.174144 10294 raft_consensus.cc:2454] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c2d48939b9144e180601994af7bcc4a in term 0.
I20260808 17:44:50.174147 10077 raft_consensus.cc:2454] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c2d48939b9144e180601994af7bcc4a in term 0.
I20260808 17:44:50.174365 10396 leader_election.cc:302] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c2d48939b9144e180601994af7bcc4a, f5112ec6f20b48a995fc16da59d9774b; no voters:
I20260808 17:44:50.174502 10620 raft_consensus.cc:2781] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:44:50.174571 10620 raft_consensus.cc:482] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:44:50.174598 10620 raft_consensus.cc:3037] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:50.175335 10620 raft_consensus.cc:504] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5112ec6f20b48a995fc16da59d9774b" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34587 } } peers { permanent_uuid: "9c2d48939b9144e180601994af7bcc4a" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37075 } } peers { permanent_uuid: "8d36c51eeb194849b1630beea77aeb63" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40777 } }
I20260808 17:44:50.175460 10620 leader_election.cc:288] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [CANDIDATE]: Term 1 election: Requested vote from peers f5112ec6f20b48a995fc16da59d9774b (127.9.187.194:34587), 8d36c51eeb194849b1630beea77aeb63 (127.9.187.193:40777)
I20260808 17:44:50.175609 10294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c68973c5bbb468ba5e66d9c39be5cde" candidate_uuid: "9c2d48939b9144e180601994af7bcc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5112ec6f20b48a995fc16da59d9774b"
I20260808 17:44:50.175644 10077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c68973c5bbb468ba5e66d9c39be5cde" candidate_uuid: "9c2d48939b9144e180601994af7bcc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d36c51eeb194849b1630beea77aeb63"
I20260808 17:44:50.175702 10294 raft_consensus.cc:3037] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:50.175701 10077 raft_consensus.cc:3037] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:50.176590 10077 raft_consensus.cc:2454] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c2d48939b9144e180601994af7bcc4a in term 1.
I20260808 17:44:50.176590 10294 raft_consensus.cc:2454] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c2d48939b9144e180601994af7bcc4a in term 1.
I20260808 17:44:50.176779 10396 leader_election.cc:302] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d36c51eeb194849b1630beea77aeb63, 9c2d48939b9144e180601994af7bcc4a; no voters:
I20260808 17:44:50.176859 10620 raft_consensus.cc:2781] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:50.176985 10620 raft_consensus.cc:686] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 1 LEADER]: Becoming Leader. State: Replica: 9c2d48939b9144e180601994af7bcc4a, State: Running, Role: LEADER
I20260808 17:44:50.177057 10620 consensus_queue.cc:237] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5112ec6f20b48a995fc16da59d9774b" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34587 } } peers { permanent_uuid: "9c2d48939b9144e180601994af7bcc4a" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37075 } } peers { permanent_uuid: "8d36c51eeb194849b1630beea77aeb63" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40777 } }
I20260808 17:44:50.177920 9836 catalog_manager.cc:5495] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c2d48939b9144e180601994af7bcc4a (127.9.187.195). New cstate: current_term: 1 leader_uuid: "9c2d48939b9144e180601994af7bcc4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5112ec6f20b48a995fc16da59d9774b" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c2d48939b9144e180601994af7bcc4a" member_type: VOTER last_known_addr { host: "127.9.187.195" port: 37075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d36c51eeb194849b1630beea77aeb63" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40777 } health_report { overall_health: UNKNOWN } } }
I20260808 17:44:50.210008 10608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.208005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59066 (local address 127.9.187.195:37075)
0808 17:44:50.208057 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:50.208059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:50.208067 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:50.208102 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:50.208103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:50.208121 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:50.208178 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:44:50.208284 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.208742 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.209410 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:50.209582 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:50.209623 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:50.209732 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:44:50.209828 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:44:50.209882 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:50.209898 (+ 16us) server_negotiation.cc:299] Negotiation successful
0808 17:44:50.209912 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:44:50.211798 10294 raft_consensus.cc:1261] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b [term 1 FOLLOWER]: Refusing update from remote peer 9c2d48939b9144e180601994af7bcc4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:50.211798 10077 raft_consensus.cc:1261] T 5c68973c5bbb468ba5e66d9c39be5cde P 8d36c51eeb194849b1630beea77aeb63 [term 1 FOLLOWER]: Refusing update from remote peer 9c2d48939b9144e180601994af7bcc4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:44:50.212134 10628 consensus_queue.cc:1035] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d36c51eeb194849b1630beea77aeb63" member_type: VOTER last_known_addr { host: "127.9.187.193" port: 40777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:50.212265 10620 consensus_queue.cc:1035] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5112ec6f20b48a995fc16da59d9774b" member_type: VOTER last_known_addr { host: "127.9.187.194" port: 34587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:44:50.214488 10633 mvcc.cc:205] Tried to move back new op lower bound from 7316320625504858112 to 7316320625365962752. Current Snapshot: MvccSnapshot[applied={T|T < 7316320625504858112}]
I20260808 17:44:50.214856 10634 mvcc.cc:205] Tried to move back new op lower bound from 7316320625504858112 to 7316320625365962752. Current Snapshot: MvccSnapshot[applied={T|T < 7316320625504858112}]
I20260808 17:44:50.216858 9836 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:50.216941 9836 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:44:50.217590 9836 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0f2145430e1448ddbb665883af6caaca: Sending DeleteTablet for 3 replicas of tablet 5c68973c5bbb468ba5e66d9c39be5cde
I20260808 17:44:50.217913 10263 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c68973c5bbb468ba5e66d9c39be5cde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:50 UTC) from {username='slave'} at 127.0.0.1:60798
I20260808 17:44:50.217935 10045 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c68973c5bbb468ba5e66d9c39be5cde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:50 UTC) from {username='slave'} at 127.0.0.1:53196
I20260808 17:44:50.218258 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 9937
I20260808 17:44:50.218278 10471 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c68973c5bbb468ba5e66d9c39be5cde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:44:50 UTC) from {username='slave'} at 127.0.0.1:59050
I20260808 17:44:50.218483 10648 tablet_replica.cc:330] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a: stopping tablet replica
I20260808 17:44:50.218618 10648 raft_consensus.cc:2229] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:44:50.218755 10646 tablet_replica.cc:330] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: stopping tablet replica
I20260808 17:44:50.218770 10648 raft_consensus.cc:2258] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:50.218878 10646 raft_consensus.cc:2229] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:44:50.219003 10646 raft_consensus.cc:2258] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:44:50.224076 10648 ts_tablet_manager.cc:1905] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:50.224958 10646 ts_tablet_manager.cc:1905] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:44:50.225838 10648 ts_tablet_manager.cc:1918] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:50.225982 10648 log.cc:1196] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-2/wal/wals/5c68973c5bbb468ba5e66d9c39be5cde
I20260808 17:44:50.226325 10648 ts_tablet_manager.cc:1939] T 5c68973c5bbb468ba5e66d9c39be5cde P 9c2d48939b9144e180601994af7bcc4a: Deleting consensus metadata
I20260808 17:44:50.226802 9816 catalog_manager.cc:4841] TS 9c2d48939b9144e180601994af7bcc4a (127.9.187.195:37075): tablet 5c68973c5bbb468ba5e66d9c39be5cde (table test-table [id=998f79affdee49aa84e9cedfd95287de]) successfully deleted
I20260808 17:44:50.227339 10646 ts_tablet_manager.cc:1918] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:44:50.227439 10646 log.cc:1196] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: Deleting WAL directory at /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786210848752357-9967-0/minicluster-data/ts-1/wal/wals/5c68973c5bbb468ba5e66d9c39be5cde
I20260808 17:44:50.227753 10646 ts_tablet_manager.cc:1939] T 5c68973c5bbb468ba5e66d9c39be5cde P f5112ec6f20b48a995fc16da59d9774b: Deleting consensus metadata
I20260808 17:44:50.228322 9815 catalog_manager.cc:4841] TS f5112ec6f20b48a995fc16da59d9774b (127.9.187.194:34587): tablet 5c68973c5bbb468ba5e66d9c39be5cde (table test-table [id=998f79affdee49aa84e9cedfd95287de]) successfully deleted
W20260808 17:44:50.237840 9815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.187.193:40777 (error 108)
I20260808 17:44:50.238041 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 10159
I20260808 17:44:50.240816 10606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:50.238207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.193:40777 (local address 127.0.0.1:53206)
0808 17:44:50.240729 (+ 2522us) negotiation.cc:107] Waiting for socket to connect
0808 17:44:50.240780 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.193:40777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2495}
W20260808 17:44:50.242457 9815 catalog_manager.cc:4584] TS 8d36c51eeb194849b1630beea77aeb63 (127.9.187.193:40777): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5c68973c5bbb468ba5e66d9c39be5cde: Network error: Client connection negotiation failed: client connection to 127.9.187.193:40777: connect: Connection refused (error 111)
I20260808 17:44:50.245347 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 10373
I20260808 17:44:50.256836 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 9785
2026-08-08T17:44:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (857 ms)
[----------] 6 tests from EncryptionPolicyTest (8885 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:44:50 dist-test-slave-bqcl krb5kdc[10654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:44:50 dist-test-slave-bqcl krb5kdc[10654](info): set up 2 sockets
Aug 08 17:44:50 dist-test-slave-bqcl krb5kdc[10654](info): commencing operation
krb5kdc: starting...
W20260808 17:44:51.407923 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:44:51 dist-test-slave-bqcl krb5kdc[10654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:44:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:44:51.529078 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45853
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:51.610446 10680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:51.610663 10680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:51.610695 10680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:51.611795 10680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:51.611840 10680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:51.611857 10680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:51.611874 10680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:51.611888 10680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:51.613317 10680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45853
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:51.613564 10680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:51.613787 10680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:51.618352 10688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:51.618362 10697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:51.618362 10690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:51.618772 10680 server_base.cc:1034] running on GCE node
I20260808 17:44:51.619032 10680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:51.619287 10680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:51.620436 10680 hybrid_clock.cc:648] HybridClock initialized: now 1786211091620420 us; error 32 us; skew 500 ppm
Aug 08 17:44:51 dist-test-slave-bqcl krb5kdc[10654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211091, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:51.625869 10680 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:44:51.626345 10680 webserver.cc:460] Webserver started at http://127.0.0.1:37143/ using document root <none> and password file <none>
I20260808 17:44:51.626549 10680 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:51.626605 10680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:51.626711 10680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:51.627727 10680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "85283f7146d14a5080cd8b79b48c1183"
format_stamp: "Formatted at 2026-08-08 17:44:51 on dist-test-slave-bqcl"
server_key: "4c8b3a35e36d191f968ff553d7507a39"
server_key_iv: "0132c49ffba72c9756999225e0155a72"
server_key_version: "encryptionkey@0"
I20260808 17:44:51.628029 10680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "85283f7146d14a5080cd8b79b48c1183"
format_stamp: "Formatted at 2026-08-08 17:44:51 on dist-test-slave-bqcl"
server_key: "4c8b3a35e36d191f968ff553d7507a39"
server_key_iv: "0132c49ffba72c9756999225e0155a72"
server_key_version: "encryptionkey@0"
I20260808 17:44:51.629318 10680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:44:51.630003 10712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:51.630213 10680 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:51.630306 10680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "85283f7146d14a5080cd8b79b48c1183"
format_stamp: "Formatted at 2026-08-08 17:44:51 on dist-test-slave-bqcl"
server_key: "4c8b3a35e36d191f968ff553d7507a39"
server_key_iv: "0132c49ffba72c9756999225e0155a72"
server_key_version: "encryptionkey@0"
I20260808 17:44:51.630378 10680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:51.652043 10680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:51.653800 10680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:51.653928 10680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:51.657986 10680 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45853
I20260808 17:44:51.658020 10803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45853 every 8 connection(s)
I20260808 17:44:51.658380 10680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:51.659353 10805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:51.661580 10805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183: Bootstrap starting.
I20260808 17:44:51.662096 10805 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:51.662398 10805 log.cc:824] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:51.663023 10805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183: No bootstrap required, opened a new log
I20260808 17:44:51.664275 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 10680
I20260808 17:44:51.664395 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:51.664588 9967 external_mini_cluster.cc:1428] Setting key 66a1101fc9473335bca5df79fd7a5013
I20260808 17:44:51.664803 10805 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85283f7146d14a5080cd8b79b48c1183" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } }
I20260808 17:44:51.664944 10805 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:51.664978 10805 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85283f7146d14a5080cd8b79b48c1183, State: Initialized, Role: FOLLOWER
I20260808 17:44:51.665148 10805 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85283f7146d14a5080cd8b79b48c1183" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } }
I20260808 17:44:51.665337 10805 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:51.665382 10805 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:51.665426 10805 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:51.666289 10805 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85283f7146d14a5080cd8b79b48c1183" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } }
I20260808 17:44:51.666385 10805 leader_election.cc:302] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85283f7146d14a5080cd8b79b48c1183; no voters:
I20260808 17:44:51.666571 10805 leader_election.cc:288] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:51.666649 10811 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:51.666814 10805 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:51.666834 10811 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [term 1 LEADER]: Becoming Leader. State: Replica: 85283f7146d14a5080cd8b79b48c1183, State: Running, Role: LEADER
I20260808 17:44:51.667055 10811 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85283f7146d14a5080cd8b79b48c1183" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } }
I20260808 17:44:51.667428 10814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85283f7146d14a5080cd8b79b48c1183" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85283f7146d14a5080cd8b79b48c1183" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } } }
I20260808 17:44:51.667505 10814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:51.667738 10822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85283f7146d14a5080cd8b79b48c1183. Latest consensus state: current_term: 1 leader_uuid: "85283f7146d14a5080cd8b79b48c1183" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85283f7146d14a5080cd8b79b48c1183" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } } }
I20260808 17:44:51.668035 10834 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:51.668586 10834 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:51.668040 10822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:51.670042 10834 catalog_manager.cc:1347] Generated new cluster ID: f5afa777897144708e186328bb8685a2
I20260808 17:44:51.670094 10834 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:44:51 dist-test-slave-bqcl krb5kdc[10654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 17:44:51.683800 10810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:51.665087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35277 (local address 127.0.0.1:45853)
0808 17:44:51.665365 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:51.665375 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:51.665418 (+ 43us) server_negotiation.cc:407] Connection header received
0808 17:44:51.665539 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:51.665545 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:51.665588 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:51.665715 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:51.666450 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:51.667811 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:51.668834 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:51.669403 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:51.669516 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:51.680139 (+ 10623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:51.680143 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:51.680144 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:51.680158 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:51.682150 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:51.682566 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:51.682570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:51.682570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:51.682684 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:51.682883 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:51.682884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:51.682884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:51.683204 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:51.683367 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:51.683446 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 17:44:51.683549 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":87,"threads_started":1}
I20260808 17:44:51.684712 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:44:51.686687 10834 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:51.687355 10834 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:51.693387 10810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:51.686190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36867 (local address 127.0.0.1:45853)
0808 17:44:51.686233 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:51.686235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:51.686507 (+ 272us) server_negotiation.cc:407] Connection header received
0808 17:44:51.686529 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:51.686530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:51.686540 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:51.686587 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:51.687212 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:51.688244 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:51.689187 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:51.689477 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:51.689509 (+ 32us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:51.690822 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:51.690823 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:51.690823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:51.690830 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:51.692236 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:51.692619 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:51.692620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:51.692621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:51.692670 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:51.692850 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:51.692851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:51.692851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:51.692952 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:51.693048 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:51.693246 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 17:44:51.693304 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:44:51.698233 10834 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85283f7146d14a5080cd8b79b48c1183: Generated new TSK 0
I20260808 17:44:51.698390 10834 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:44:51.704493 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 10680
W20260808 17:44:51.719674 10651 connection.cc:535] client connection to 127.0.0.1:45853 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45853): Connection reset by peer (error 104)
2026-08-08T17:44:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1450 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:44:51 dist-test-slave-bqcl krb5kdc[10868](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:44:51 dist-test-slave-bqcl krb5kdc[10868](info): set up 2 sockets
Aug 08 17:44:51 dist-test-slave-bqcl krb5kdc[10868](info): commencing operation
krb5kdc: starting...
W20260808 17:44:52.849040 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:44:52 dist-test-slave-bqcl krb5kdc[10868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:44:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:44:52.962705 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37635
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:53.041711 10885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:53.041896 10885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:53.041917 10885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:53.042977 10885 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:53.043011 10885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:53.043025 10885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:53.043036 10885 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:53.043047 10885 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:53.044416 10885 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37635
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:53.044591 10885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:53.044762 10885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:53.049237 10898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:53.049300 10902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:53.049289 10897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:53.049466 10885 server_base.cc:1034] running on GCE node
I20260808 17:44:53.049727 10885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:53.049974 10885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:53.051110 10885 hybrid_clock.cc:648] HybridClock initialized: now 1786211093051095 us; error 35 us; skew 500 ppm
Aug 08 17:44:53 dist-test-slave-bqcl krb5kdc[10868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211093, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:53.053493 10885 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:44:53.053912 10885 webserver.cc:460] Webserver started at http://127.0.0.1:45381/ using document root <none> and password file <none>
I20260808 17:44:53.054147 10885 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:53.054214 10885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:53.054343 10885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:53.055311 10885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "ebbc5893f39343e4928599886096bed2"
format_stamp: "Formatted at 2026-08-08 17:44:53 on dist-test-slave-bqcl"
server_key: "4ecddbf22979956b9080be8ef24d0589"
server_key_iv: "9c8a0735e5b35f4a9aa508b17a6241e4"
server_key_version: "encryptionkey@0"
I20260808 17:44:53.055634 10885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "ebbc5893f39343e4928599886096bed2"
format_stamp: "Formatted at 2026-08-08 17:44:53 on dist-test-slave-bqcl"
server_key: "4ecddbf22979956b9080be8ef24d0589"
server_key_iv: "9c8a0735e5b35f4a9aa508b17a6241e4"
server_key_version: "encryptionkey@0"
I20260808 17:44:53.056821 10885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:44:53.057448 10912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:53.057592 10885 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:53.057674 10885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "ebbc5893f39343e4928599886096bed2"
format_stamp: "Formatted at 2026-08-08 17:44:53 on dist-test-slave-bqcl"
server_key: "4ecddbf22979956b9080be8ef24d0589"
server_key_iv: "9c8a0735e5b35f4a9aa508b17a6241e4"
server_key_version: "encryptionkey@0"
I20260808 17:44:53.057737 10885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:53.073859 10885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:53.075618 10885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:53.075747 10885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:53.079748 10885 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37635
I20260808 17:44:53.079797 10999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37635 every 8 connection(s)
I20260808 17:44:53.080117 10885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:53.081121 11001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:53.083420 11001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2: Bootstrap starting.
I20260808 17:44:53.083989 11001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:53.084256 11001 log.cc:824] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:53.084893 11001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2: No bootstrap required, opened a new log
I20260808 17:44:53.086550 11001 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebbc5893f39343e4928599886096bed2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } }
I20260808 17:44:53.086691 11001 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:53.086714 11001 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebbc5893f39343e4928599886096bed2, State: Initialized, Role: FOLLOWER
I20260808 17:44:53.086859 11001 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebbc5893f39343e4928599886096bed2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } }
I20260808 17:44:53.086949 11001 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:53.086990 11001 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:53.086997 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 10885
I20260808 17:44:53.087040 11001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:53.087106 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:53.087298 9967 external_mini_cluster.cc:1428] Setting key 64e7f1d80353bf41baaa94a4d8672fa3
I20260808 17:44:53.087646 11001 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebbc5893f39343e4928599886096bed2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } }
I20260808 17:44:53.087747 11001 leader_election.cc:302] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebbc5893f39343e4928599886096bed2; no voters:
I20260808 17:44:53.087914 11001 leader_election.cc:288] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:53.087955 11006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:53.088181 11006 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [term 1 LEADER]: Becoming Leader. State: Replica: ebbc5893f39343e4928599886096bed2, State: Running, Role: LEADER
I20260808 17:44:53.088227 11001 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:53.088285 11006 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebbc5893f39343e4928599886096bed2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } }
I20260808 17:44:53.088654 11006 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebbc5893f39343e4928599886096bed2. Latest consensus state: current_term: 1 leader_uuid: "ebbc5893f39343e4928599886096bed2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebbc5893f39343e4928599886096bed2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } } }
I20260808 17:44:53.088788 11006 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:53.088959 11010 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebbc5893f39343e4928599886096bed2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebbc5893f39343e4928599886096bed2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } } }
I20260808 17:44:53.089120 11010 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:53.089068 11022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:53.090267 11022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:53.092300 11022 catalog_manager.cc:1347] Generated new cluster ID: 8ab8d81ca31941389e83596083b95a27
I20260808 17:44:53.092350 11022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:53.093492 11009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:53.087938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45025 (local address 127.0.0.1:37635)
0808 17:44:53.088127 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:53.088136 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:53.088170 (+ 34us) server_negotiation.cc:407] Connection header received
0808 17:44:53.088287 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:53.088294 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:53.088350 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:53.088538 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:53.088786 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:53.090145 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:53.091175 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:53.091753 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:53.091863 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:53.092790 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:53.092794 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:53.092795 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:53.093006 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:53.093048 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:53.093065 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:53.093155 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:53.093239 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 17:44:53.093268 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":74,"threads_started":1}
I20260808 17:44:53.094501 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:44:53.101610 11009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:53.096012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41009 (local address 127.0.0.1:37635)
0808 17:44:53.096044 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:53.096045 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:53.098290 (+ 2245us) server_negotiation.cc:407] Connection header received
0808 17:44:53.098385 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:53.098386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:53.098398 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:53.098460 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:53.098596 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:53.099311 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:53.100323 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:53.100614 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:53.100677 (+ 63us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:53.101366 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:53.101367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:53.101368 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:53.101372 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:53.101386 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:53.101391 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:53.101447 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:53.101524 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 17:44:53.101538 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:44:53.129051 11022 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:53.129818 11022 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:53.135667 11022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebbc5893f39343e4928599886096bed2: Generated new TSK 0
I20260808 17:44:53.135864 11022 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:44:53.137950 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 10885
W20260808 17:44:53.157608 10866 connection.cc:535] client connection to 127.0.0.1:37635 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37635): Connection reset by peer (error 104)
2026-08-08T17:44:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1438 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:44:53 dist-test-slave-bqcl krb5kdc[11045](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:44:53 dist-test-slave-bqcl krb5kdc[11045](info): set up 2 sockets
Aug 08 17:44:53 dist-test-slave-bqcl krb5kdc[11045](info): commencing operation
krb5kdc: starting...
W20260808 17:44:54.295703 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:44:54 dist-test-slave-bqcl krb5kdc[11045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211094, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:44:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:44:54.408704 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39893
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:54.487965 11064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:54.488162 11064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:54.488193 11064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:54.489310 11064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:54.489351 11064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:54.489368 11064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:54.489384 11064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:54.489398 11064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:54.490852 11064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39893
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:54.491091 11064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:54.491291 11064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:54.495889 11071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:54.495916 11064 server_base.cc:1034] running on GCE node
W20260808 17:44:54.496021 11073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:54.496248 11069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:54.496557 11064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:54.496907 11064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:54.498068 11064 hybrid_clock.cc:648] HybridClock initialized: now 1786211094498048 us; error 42 us; skew 500 ppm
Aug 08 17:44:54 dist-test-slave-bqcl krb5kdc[11045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211094, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:54.501224 11064 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:44:54.501708 11064 webserver.cc:460] Webserver started at http://127.0.0.1:35301/ using document root <none> and password file <none>
I20260808 17:44:54.501974 11064 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:54.502036 11064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:54.502179 11064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:54.503348 11064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "ee311d102eed4a5eb06b3233ee0f9c82"
format_stamp: "Formatted at 2026-08-08 17:44:54 on dist-test-slave-bqcl"
server_key: "9d671e1122b1297e55f3552dce8a7739"
server_key_iv: "ff2924a1e34fdc1d92c85d56043ce526"
server_key_version: "encryptionkey@0"
I20260808 17:44:54.503664 11064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "ee311d102eed4a5eb06b3233ee0f9c82"
format_stamp: "Formatted at 2026-08-08 17:44:54 on dist-test-slave-bqcl"
server_key: "9d671e1122b1297e55f3552dce8a7739"
server_key_iv: "ff2924a1e34fdc1d92c85d56043ce526"
server_key_version: "encryptionkey@0"
I20260808 17:44:54.505100 11064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:44:54.505959 11081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:54.506150 11064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:44:54.506232 11064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "ee311d102eed4a5eb06b3233ee0f9c82"
format_stamp: "Formatted at 2026-08-08 17:44:54 on dist-test-slave-bqcl"
server_key: "9d671e1122b1297e55f3552dce8a7739"
server_key_iv: "ff2924a1e34fdc1d92c85d56043ce526"
server_key_version: "encryptionkey@0"
I20260808 17:44:54.506304 11064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:54.509509 11064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:54.511253 11064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:54.511380 11064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:54.515182 11064 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39893
I20260808 17:44:54.515268 11162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39893 every 8 connection(s)
I20260808 17:44:54.515547 11064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:54.516499 11165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:54.518805 11165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82: Bootstrap starting.
I20260808 17:44:54.519343 11165 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:54.519577 11165 log.cc:824] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:54.520208 11165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82: No bootstrap required, opened a new log
I20260808 17:44:54.521741 11165 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee311d102eed4a5eb06b3233ee0f9c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39893 } }
I20260808 17:44:54.521874 11165 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:54.521895 11165 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee311d102eed4a5eb06b3233ee0f9c82, State: Initialized, Role: FOLLOWER
I20260808 17:44:54.522006 11165 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee311d102eed4a5eb06b3233ee0f9c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39893 } }
I20260808 17:44:54.522085 11165 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:54.522115 11165 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:54.522188 11165 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:54.522663 11165 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee311d102eed4a5eb06b3233ee0f9c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39893 } }
I20260808 17:44:54.522750 11165 leader_election.cc:302] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee311d102eed4a5eb06b3233ee0f9c82; no voters:
I20260808 17:44:54.522876 11165 leader_election.cc:288] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:54.522928 11168 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:54.523092 11165 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:54.523104 11168 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [term 1 LEADER]: Becoming Leader. State: Replica: ee311d102eed4a5eb06b3233ee0f9c82, State: Running, Role: LEADER
I20260808 17:44:54.523212 11168 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee311d102eed4a5eb06b3233ee0f9c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39893 } }
I20260808 17:44:54.523550 11170 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee311d102eed4a5eb06b3233ee0f9c82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee311d102eed4a5eb06b3233ee0f9c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39893 } } }
I20260808 17:44:54.523559 11173 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee311d102eed4a5eb06b3233ee0f9c82. Latest consensus state: current_term: 1 leader_uuid: "ee311d102eed4a5eb06b3233ee0f9c82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee311d102eed4a5eb06b3233ee0f9c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39893 } } }
I20260808 17:44:54.523669 11170 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:54.523674 11173 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:54.523890 11177 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:54.524406 11177 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:54.524658 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 11064
I20260808 17:44:54.524770 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:54.524948 9967 external_mini_cluster.cc:1428] Setting key b74d343b089b03547fd97f07e4a05d13
I20260808 17:44:54.526971 11177 catalog_manager.cc:1347] Generated new cluster ID: 579ff411108f48e980f72bba4a4149b9
I20260808 17:44:54.527026 11177 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:54.527384 11197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:54.525395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46355 (local address 127.0.0.1:39893)
0808 17:44:54.525699 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:54.525708 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:54.525739 (+ 31us) server_negotiation.cc:407] Connection header received
0808 17:44:54.525854 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:54.525861 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:54.525891 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:54.526029 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:54.526771 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:54.526774 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:54.526774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:54.526778 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:54.526821 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:54.526835 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:54.526932 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:54.527167 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 17:44:54.527212 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":90,"threads_started":1}
I20260808 17:44:54.528224 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:44:54.531420 11197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:54.530400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40275 (local address 127.0.0.1:39893)
0808 17:44:54.530432 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:54.530433 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:54.530567 (+ 134us) server_negotiation.cc:407] Connection header received
0808 17:44:54.530617 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:54.530617 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:54.530623 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:54.530701 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:54.531222 (+ 521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:54.531223 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:54.531223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:54.531227 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:54.531240 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:54.531245 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:54.531303 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:54.531347 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 17:44:54.531359 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:44:54.558209 11177 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:54.558408 11177 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:54.572042 11177 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee311d102eed4a5eb06b3233ee0f9c82: Generated new TSK 0
I20260808 17:44:54.572263 11177 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:44:54.576351 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 11064
2026-08-08T17:44:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1432 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:44:54 dist-test-slave-bqcl krb5kdc[11212](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:44:54 dist-test-slave-bqcl krb5kdc[11212](info): set up 2 sockets
Aug 08 17:44:54 dist-test-slave-bqcl krb5kdc[11212](info): commencing operation
krb5kdc: starting...
W20260808 17:44:55.725907 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:44:55 dist-test-slave-bqcl krb5kdc[11212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:44:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:44:55.840253 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40229
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:55.920499 11227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:55.920706 11227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:55.920737 11227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:55.921828 11227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:55.921869 11227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:55.921888 11227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:55.921903 11227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:55.921921 11227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:55.923372 11227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:55.923614 11227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:55.923812 11227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:55.928336 11240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:55.928344 11238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:55.928377 11236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:55.928511 11227 server_base.cc:1034] running on GCE node
I20260808 17:44:55.928789 11227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:55.929047 11227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:55.930205 11227 hybrid_clock.cc:648] HybridClock initialized: now 1786211095930185 us; error 33 us; skew 500 ppm
Aug 08 17:44:55 dist-test-slave-bqcl krb5kdc[11212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211095, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:55.932651 11227 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:44:55.933128 11227 webserver.cc:460] Webserver started at http://127.0.0.1:36425/ using document root <none> and password file <none>
I20260808 17:44:55.933338 11227 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:55.933385 11227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:55.933527 11227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:55.934594 11227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "861093f5788b46f88e5391f2dbb99483"
format_stamp: "Formatted at 2026-08-08 17:44:55 on dist-test-slave-bqcl"
server_key: "bcc1e7538c8010f7f6c8374ec36b70ce"
server_key_iv: "6848fbbc055f6e75dfc9a80fbd0ff350"
server_key_version: "encryptionkey@0"
I20260808 17:44:55.934938 11227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "861093f5788b46f88e5391f2dbb99483"
format_stamp: "Formatted at 2026-08-08 17:44:55 on dist-test-slave-bqcl"
server_key: "bcc1e7538c8010f7f6c8374ec36b70ce"
server_key_iv: "6848fbbc055f6e75dfc9a80fbd0ff350"
server_key_version: "encryptionkey@0"
I20260808 17:44:55.936277 11227 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:44:55.936980 11247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:55.937124 11227 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:55.937217 11227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "861093f5788b46f88e5391f2dbb99483"
format_stamp: "Formatted at 2026-08-08 17:44:55 on dist-test-slave-bqcl"
server_key: "bcc1e7538c8010f7f6c8374ec36b70ce"
server_key_iv: "6848fbbc055f6e75dfc9a80fbd0ff350"
server_key_version: "encryptionkey@0"
I20260808 17:44:55.937290 11227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:55.955271 11227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:55.957041 11227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:55.957182 11227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:55.960986 11227 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40229
I20260808 17:44:55.961030 11328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40229 every 8 connection(s)
I20260808 17:44:55.961356 11227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:55.962327 11329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:55.964512 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 11227
I20260808 17:44:55.964638 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:55.964643 11329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483: Bootstrap starting.
I20260808 17:44:55.964833 9967 external_mini_cluster.cc:1428] Setting key 96ebcd79a6aa3adddce21d64e9415ae4
I20260808 17:44:55.965338 11329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:55.965631 11329 log.cc:824] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:55.966331 11329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483: No bootstrap required, opened a new log
I20260808 17:44:55.968410 11329 raft_consensus.cc:348] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "861093f5788b46f88e5391f2dbb99483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40229 } }
I20260808 17:44:55.968576 11329 raft_consensus.cc:374] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:55.968606 11329 raft_consensus.cc:729] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 861093f5788b46f88e5391f2dbb99483, State: Initialized, Role: FOLLOWER
I20260808 17:44:55.968731 11329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "861093f5788b46f88e5391f2dbb99483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40229 } }
I20260808 17:44:55.968798 11329 raft_consensus.cc:388] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:55.968832 11329 raft_consensus.cc:482] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:55.968876 11329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:55.969378 11329 raft_consensus.cc:504] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "861093f5788b46f88e5391f2dbb99483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40229 } }
I20260808 17:44:55.969480 11329 leader_election.cc:302] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 861093f5788b46f88e5391f2dbb99483; no voters:
I20260808 17:44:55.969641 11329 leader_election.cc:288] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:55.969679 11337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:55.969825 11337 raft_consensus.cc:686] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [term 1 LEADER]: Becoming Leader. State: Replica: 861093f5788b46f88e5391f2dbb99483, State: Running, Role: LEADER
I20260808 17:44:55.969903 11329 sys_catalog.cc:564] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:55.969916 11337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "861093f5788b46f88e5391f2dbb99483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40229 } }
I20260808 17:44:55.970291 11337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 861093f5788b46f88e5391f2dbb99483. Latest consensus state: current_term: 1 leader_uuid: "861093f5788b46f88e5391f2dbb99483" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "861093f5788b46f88e5391f2dbb99483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40229 } } }
I20260808 17:44:55.970366 11337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:55.970526 11341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "861093f5788b46f88e5391f2dbb99483" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "861093f5788b46f88e5391f2dbb99483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40229 } } }
I20260808 17:44:55.970588 11341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:55.971130 11345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 17:44:55 dist-test-slave-bqcl krb5kdc[11212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 17:44:55.971554 11345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:55.973266 11345 catalog_manager.cc:1347] Generated new cluster ID: 005369fd2a464f638999797bb16aec27
I20260808 17:44:55.973318 11345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:55.975553 11335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:55.965350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45621 (local address 127.0.0.1:40229)
0808 17:44:55.965534 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:55.965542 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:55.965569 (+ 27us) server_negotiation.cc:407] Connection header received
0808 17:44:55.966135 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:55.966146 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:55.966212 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:55.966325 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:55.967077 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:55.967939 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:55.968973 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:55.969370 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:55.969453 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:55.972135 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:55.972138 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:55.972139 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:55.972151 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:55.973944 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:55.974364 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:55.974367 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:55.974367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:55.974484 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:55.974688 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:55.974689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:55.974689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:55.974961 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:55.975104 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:55.975217 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 17:44:55.975343 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":67,"threads_started":1}
I20260808 17:44:55.976384 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:44:55.978118 11345 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:55.978577 11345 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:55.981987 11345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 861093f5788b46f88e5391f2dbb99483: Generated new TSK 0
I20260808 17:44:55.982158 11345 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:44:55.984572 11335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:55.977992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57709 (local address 127.0.0.1:40229)
0808 17:44:55.978023 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:55.978024 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:55.978032 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:55.978049 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:55.978050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:55.978058 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:55.978114 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:55.978877 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:55.979621 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:55.980635 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:55.980963 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:55.981002 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:55.982511 (+ 1509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:55.982512 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:55.982512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:44:55.982517 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:55.983666 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:55.984003 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:55.984003 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:55.984003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:55.984046 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:44:55.984192 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:44:55.984192 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:44:55.984192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:44:55.984279 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:55.984342 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:55.984455 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 17:44:55.984517 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:44:55.986361 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 11227
2026-08-08T17:44:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1409 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:44:56 dist-test-slave-bqcl krb5kdc[11383](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:44:56 dist-test-slave-bqcl krb5kdc[11383](info): set up 2 sockets
Aug 08 17:44:56 dist-test-slave-bqcl krb5kdc[11383](info): commencing operation
krb5kdc: starting...
W20260808 17:44:57.136428 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:44:57 dist-test-slave-bqcl krb5kdc[11383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:44:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:44:57.252631 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42063
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:57.334210 11407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:57.334408 11407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:57.334430 11407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:57.335521 11407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:57.335562 11407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:57.335575 11407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:57.335587 11407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:57.335597 11407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:57.337039 11407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:57.337236 11407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:57.337409 11407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:57.342003 11416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:57.341995 11417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:57.342088 11407 server_base.cc:1034] running on GCE node
W20260808 17:44:57.341993 11419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:57.342479 11407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:57.342793 11407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:57.343925 11407 hybrid_clock.cc:648] HybridClock initialized: now 1786211097343914 us; error 29 us; skew 500 ppm
Aug 08 17:44:57 dist-test-slave-bqcl krb5kdc[11383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211097, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:57.350157 11407 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:44:57.350594 11407 webserver.cc:460] Webserver started at http://127.0.0.1:39271/ using document root <none> and password file <none>
I20260808 17:44:57.350814 11407 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:57.350870 11407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:57.350991 11407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:57.352015 11407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "e310cf75d9c242d9b1f5bc40c8558edd"
format_stamp: "Formatted at 2026-08-08 17:44:57 on dist-test-slave-bqcl"
server_key: "82306dfc720ddbbbee899836089a75ff"
server_key_iv: "502c7b76eaad912a3299abee51f788ff"
server_key_version: "encryptionkey@0"
I20260808 17:44:57.352358 11407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "e310cf75d9c242d9b1f5bc40c8558edd"
format_stamp: "Formatted at 2026-08-08 17:44:57 on dist-test-slave-bqcl"
server_key: "82306dfc720ddbbbee899836089a75ff"
server_key_iv: "502c7b76eaad912a3299abee51f788ff"
server_key_version: "encryptionkey@0"
I20260808 17:44:57.353597 11407 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:44:57.354285 11432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:57.354434 11407 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:57.354519 11407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "e310cf75d9c242d9b1f5bc40c8558edd"
format_stamp: "Formatted at 2026-08-08 17:44:57 on dist-test-slave-bqcl"
server_key: "82306dfc720ddbbbee899836089a75ff"
server_key_iv: "502c7b76eaad912a3299abee51f788ff"
server_key_version: "encryptionkey@0"
I20260808 17:44:57.354588 11407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:57.371266 11407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:57.373461 11407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:57.373605 11407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:57.377837 11407 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42063
I20260808 17:44:57.377877 11515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42063 every 8 connection(s)
I20260808 17:44:57.378273 11407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:57.379249 11516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:57.381469 11516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd: Bootstrap starting.
I20260808 17:44:57.381984 11516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:57.382285 11516 log.cc:824] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:57.382915 11516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd: No bootstrap required, opened a new log
I20260808 17:44:57.384428 11516 raft_consensus.cc:348] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e310cf75d9c242d9b1f5bc40c8558edd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42063 } }
I20260808 17:44:57.384563 11516 raft_consensus.cc:374] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:57.384588 11516 raft_consensus.cc:729] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e310cf75d9c242d9b1f5bc40c8558edd, State: Initialized, Role: FOLLOWER
I20260808 17:44:57.384685 11516 consensus_queue.cc:260] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e310cf75d9c242d9b1f5bc40c8558edd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42063 } }
I20260808 17:44:57.384737 11516 raft_consensus.cc:388] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:57.384755 11516 raft_consensus.cc:482] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:57.384795 11516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:57.385299 11516 raft_consensus.cc:504] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e310cf75d9c242d9b1f5bc40c8558edd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42063 } }
I20260808 17:44:57.385387 11516 leader_election.cc:302] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e310cf75d9c242d9b1f5bc40c8558edd; no voters:
I20260808 17:44:57.385533 11516 leader_election.cc:288] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:57.385587 11519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:57.385779 11519 raft_consensus.cc:686] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [term 1 LEADER]: Becoming Leader. State: Replica: e310cf75d9c242d9b1f5bc40c8558edd, State: Running, Role: LEADER
I20260808 17:44:57.385780 11516 sys_catalog.cc:564] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:57.385896 11519 consensus_queue.cc:237] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e310cf75d9c242d9b1f5bc40c8558edd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42063 } }
I20260808 17:44:57.386262 11520 sys_catalog.cc:455] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e310cf75d9c242d9b1f5bc40c8558edd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e310cf75d9c242d9b1f5bc40c8558edd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42063 } } }
I20260808 17:44:57.386260 11523 sys_catalog.cc:455] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e310cf75d9c242d9b1f5bc40c8558edd. Latest consensus state: current_term: 1 leader_uuid: "e310cf75d9c242d9b1f5bc40c8558edd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e310cf75d9c242d9b1f5bc40c8558edd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42063 } } }
I20260808 17:44:57.386358 11520 sys_catalog.cc:458] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:57.386366 11523 sys_catalog.cc:458] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:57.386554 11525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:57.387130 11525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:57.387596 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 11407
I20260808 17:44:57.387698 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:57.387879 9967 external_mini_cluster.cc:1428] Setting key a81a47d65827f191c4a3b21c22b05fd5
I20260808 17:44:57.388890 11525 catalog_manager.cc:1347] Generated new cluster ID: 1474fed76c8245ddadf586aa6d0d4df2
I20260808 17:44:57.388942 11525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:57.394311 11546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:57.388312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47611 (local address 127.0.0.1:42063)
0808 17:44:57.388467 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:57.388477 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:57.390348 (+ 1871us) server_negotiation.cc:407] Connection header received
0808 17:44:57.390473 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:57.390479 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:57.390520 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:57.390657 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:57.390837 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:57.391792 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:57.392564 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:57.392980 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:57.393074 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:57.393686 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:57.393690 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:57.393691 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:57.393853 (+ 162us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:57.393883 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:57.393894 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:57.393950 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:57.394023 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 17:44:57.394084 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":67,"threads_started":1}
I20260808 17:44:57.394706 11525 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:57.395175 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:44:57.395234 11525 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:57.399947 11546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:57.396729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59323 (local address 127.0.0.1:42063)
0808 17:44:57.396761 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:57.396763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:57.396771 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:44:57.396789 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:57.396790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:57.396799 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:57.396853 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:57.396962 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:57.397705 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:57.398732 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:44:57.399040 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:44:57.399102 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:44:57.399718 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:57.399719 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:57.399719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:57.399725 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:57.399740 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:57.399745 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:57.399793 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:57.399849 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 17:44:57.399875 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:44:57.403260 11525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e310cf75d9c242d9b1f5bc40c8558edd: Generated new TSK 0
I20260808 17:44:57.403402 11525 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:44:57.409371 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 11407
2026-08-08T17:44:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1424 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:44:57 dist-test-slave-bqcl krb5kdc[11563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:44:57 dist-test-slave-bqcl krb5kdc[11563](info): set up 2 sockets
Aug 08 17:44:57 dist-test-slave-bqcl krb5kdc[11563](info): commencing operation
krb5kdc: starting...
W20260808 17:44:58.561340 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:44:58 dist-test-slave-bqcl krb5kdc[11563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:44:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:44:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:44:58.682933 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33645
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33645
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:44:58.765874 11589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:44:58.766074 11589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:44:58.766096 11589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:44:58.767232 11589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:44:58.767274 11589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:44:58.767288 11589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:44:58.767298 11589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:44:58.767309 11589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:44:58.768738 11589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:44:58.768957 11589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:44:58.769161 11589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:44:58.773627 11604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:44:58.773651 11602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:58.773787 11589 server_base.cc:1034] running on GCE node
W20260808 17:44:58.773622 11607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:44:58.774165 11589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:44:58.774452 11589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:44:58.775593 11589 hybrid_clock.cc:648] HybridClock initialized: now 1786211098775579 us; error 29 us; skew 500 ppm
Aug 08 17:44:58 dist-test-slave-bqcl krb5kdc[11563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211098, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:44:58.777978 11589 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:44:58.778443 11589 webserver.cc:460] Webserver started at http://127.0.0.1:36169/ using document root <none> and password file <none>
I20260808 17:44:58.778674 11589 fs_manager.cc:359] Metadata directory not provided
I20260808 17:44:58.778729 11589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:44:58.778857 11589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:44:58.779915 11589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "dc8a8c73220942c88a465398ad2fca43"
format_stamp: "Formatted at 2026-08-08 17:44:58 on dist-test-slave-bqcl"
server_key: "998d33b2ba1dc915fad890427beb45ca"
server_key_iv: "5986fa5b89ff54a1098b044c240fbe6f"
server_key_version: "encryptionkey@0"
I20260808 17:44:58.780270 11589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "dc8a8c73220942c88a465398ad2fca43"
format_stamp: "Formatted at 2026-08-08 17:44:58 on dist-test-slave-bqcl"
server_key: "998d33b2ba1dc915fad890427beb45ca"
server_key_iv: "5986fa5b89ff54a1098b044c240fbe6f"
server_key_version: "encryptionkey@0"
I20260808 17:44:58.781579 11589 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:44:58.782259 11626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:44:58.782403 11589 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:44:58.782524 11589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "dc8a8c73220942c88a465398ad2fca43"
format_stamp: "Formatted at 2026-08-08 17:44:58 on dist-test-slave-bqcl"
server_key: "998d33b2ba1dc915fad890427beb45ca"
server_key_iv: "5986fa5b89ff54a1098b044c240fbe6f"
server_key_version: "encryptionkey@0"
I20260808 17:44:58.782594 11589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:44:58.785844 11589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:44:58.787801 11589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:44:58.787948 11589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:44:58.792071 11589 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33645
I20260808 17:44:58.792104 11705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33645 every 8 connection(s)
I20260808 17:44:58.792414 11589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:44:58.793334 11706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:44:58.795459 11706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43: Bootstrap starting.
I20260808 17:44:58.795981 11706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43: Neither blocks nor log segments found. Creating new log.
I20260808 17:44:58.796207 11706 log.cc:824] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43: Log is configured to *not* fsync() on all Append() calls
I20260808 17:44:58.796834 11706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43: No bootstrap required, opened a new log
I20260808 17:44:58.797851 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 11589
I20260808 17:44:58.797969 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:44:58.798190 9967 external_mini_cluster.cc:1428] Setting key b3a719989037e33fd0f2ba6851c16fe0
I20260808 17:44:58.798704 11706 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8a8c73220942c88a465398ad2fca43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33645 } }
I20260808 17:44:58.798868 11706 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:44:58.798895 11706 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc8a8c73220942c88a465398ad2fca43, State: Initialized, Role: FOLLOWER
I20260808 17:44:58.799014 11706 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8a8c73220942c88a465398ad2fca43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33645 } }
I20260808 17:44:58.799085 11706 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:44:58.799106 11706 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:44:58.799151 11706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:44:58.800127 11706 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8a8c73220942c88a465398ad2fca43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33645 } }
I20260808 17:44:58.800173 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:58.798694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39023 (local address 127.0.0.1:33645)
0808 17:44:58.798852 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:58.798859 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:58.798890 (+ 31us) server_negotiation.cc:407] Connection header received
0808 17:44:58.799002 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:58.799007 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:58.799028 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:58.799166 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:58.799776 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:58.799779 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:58.799779 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:58.799783 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:58.799817 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:58.799828 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:58.799878 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:58.799958 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 17:44:58.799988 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260808 17:44:58.800215 11706 leader_election.cc:302] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc8a8c73220942c88a465398ad2fca43; no voters:
I20260808 17:44:58.800356 11706 leader_election.cc:288] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:44:58.800386 11716 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:44:58.800484 11716 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [term 1 LEADER]: Becoming Leader. State: Replica: dc8a8c73220942c88a465398ad2fca43, State: Running, Role: LEADER
I20260808 17:44:58.800614 11706 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:44:58.800614 11716 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8a8c73220942c88a465398ad2fca43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33645 } }
I20260808 17:44:58.800988 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:44:58.801046 11716 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc8a8c73220942c88a465398ad2fca43. Latest consensus state: current_term: 1 leader_uuid: "dc8a8c73220942c88a465398ad2fca43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8a8c73220942c88a465398ad2fca43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33645 } } }
I20260808 17:44:58.801059 11718 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc8a8c73220942c88a465398ad2fca43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8a8c73220942c88a465398ad2fca43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33645 } } }
I20260808 17:44:58.801129 11716 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:58.801152 11718 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43 [sys.catalog]: This master's current role is: LEADER
I20260808 17:44:58.801301 11727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:44:58.801805 11727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:44:58.803300 11727 catalog_manager.cc:1347] Generated new cluster ID: 1ba10c57a8de4380a1511dd472b169d1
I20260808 17:44:58.803354 11727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:44:58.807119 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:44:58.802674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36979 (local address 127.0.0.1:33645)
0808 17:44:58.802707 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:44:58.802709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:44:58.806327 (+ 3618us) server_negotiation.cc:407] Connection header received
0808 17:44:58.806383 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:44:58.806384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:44:58.806389 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:44:58.806436 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:44:58.806937 (+ 501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:44:58.806938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:44:58.806938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:44:58.806942 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:44:58.806955 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:44:58.806959 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:44:58.807004 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:44:58.807045 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 17:44:58.807059 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:44:58.813795 11727 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:44:58.813937 11727 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:44:58.820004 11727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc8a8c73220942c88a465398ad2fca43: Generated new TSK 0
I20260808 17:44:58.820169 11727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:44:58.828745 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 11589
2026-08-08T17:44:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1419 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:44:58 dist-test-slave-bqcl krb5kdc[11761](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:44:58 dist-test-slave-bqcl krb5kdc[11761](info): set up 2 sockets
Aug 08 17:44:58 dist-test-slave-bqcl krb5kdc[11761](info): commencing operation
krb5kdc: starting...
W20260808 17:45:00.029529 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:00 dist-test-slave-bqcl krb5kdc[11761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:45:00.148624 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45677
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:00.229838 11782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:00.230050 11782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:00.230080 11782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:00.231235 11782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:00.231276 11782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:00.231289 11782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:00.231300 11782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:00.231312 11782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:00.232725 11782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:00.232924 11782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:00.233109 11782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:45:00.237884 11782 server_base.cc:1034] running on GCE node
W20260808 17:45:00.237823 11798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:00.237818 11794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:00.237823 11793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:00.238335 11782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:00.238636 11782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:00.239797 11782 hybrid_clock.cc:648] HybridClock initialized: now 1786211100239781 us; error 32 us; skew 500 ppm
Aug 08 17:45:00 dist-test-slave-bqcl krb5kdc[11761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211100, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:00.242432 11782 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:45:00.242862 11782 webserver.cc:460] Webserver started at http://127.0.0.1:46055/ using document root <none> and password file <none>
I20260808 17:45:00.243124 11782 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:00.243178 11782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:00.243295 11782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:00.244328 11782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "e29b55a8529848a2b427bf1335e1d68a"
format_stamp: "Formatted at 2026-08-08 17:45:00 on dist-test-slave-bqcl"
server_key: "a6f17c5614596efdfcef23b9f6114e38"
server_key_iv: "b87fa358df4153bac4abc9959a987608"
server_key_version: "encryptionkey@0"
I20260808 17:45:00.244663 11782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "e29b55a8529848a2b427bf1335e1d68a"
format_stamp: "Formatted at 2026-08-08 17:45:00 on dist-test-slave-bqcl"
server_key: "a6f17c5614596efdfcef23b9f6114e38"
server_key_iv: "b87fa358df4153bac4abc9959a987608"
server_key_version: "encryptionkey@0"
I20260808 17:45:00.245926 11782 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:45:00.246680 11810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:00.246835 11782 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:00.246923 11782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "e29b55a8529848a2b427bf1335e1d68a"
format_stamp: "Formatted at 2026-08-08 17:45:00 on dist-test-slave-bqcl"
server_key: "a6f17c5614596efdfcef23b9f6114e38"
server_key_iv: "b87fa358df4153bac4abc9959a987608"
server_key_version: "encryptionkey@0"
I20260808 17:45:00.246982 11782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:00.266014 11782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:00.267918 11782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:00.268110 11782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:00.272253 11782 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45677
I20260808 17:45:00.272295 11895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45677 every 8 connection(s)
I20260808 17:45:00.272642 11782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:00.273420 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 11782
I20260808 17:45:00.273552 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:00.273744 11896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:00.273777 9967 external_mini_cluster.cc:1428] Setting key 8cdb567c3e7344d7d6c50993dc3b6412
I20260808 17:45:00.276895 11896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a: Bootstrap starting.
I20260808 17:45:00.277596 11896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:00.277908 11896 log.cc:824] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:00.278652 11896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a: No bootstrap required, opened a new log
Aug 08 17:45:00 dist-test-slave-bqcl krb5kdc[11761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 17:45:00.280932 11896 raft_consensus.cc:348] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29b55a8529848a2b427bf1335e1d68a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45677 } }
I20260808 17:45:00.281080 11896 raft_consensus.cc:374] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:00.281112 11896 raft_consensus.cc:729] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29b55a8529848a2b427bf1335e1d68a, State: Initialized, Role: FOLLOWER
I20260808 17:45:00.281236 11896 consensus_queue.cc:260] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29b55a8529848a2b427bf1335e1d68a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45677 } }
I20260808 17:45:00.281296 11896 raft_consensus.cc:388] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:00.281328 11896 raft_consensus.cc:482] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:00.281374 11896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:00.281915 11896 raft_consensus.cc:504] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29b55a8529848a2b427bf1335e1d68a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45677 } }
I20260808 17:45:00.282015 11896 leader_election.cc:302] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e29b55a8529848a2b427bf1335e1d68a; no voters:
I20260808 17:45:00.282210 11896 leader_election.cc:288] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:00.282249 11905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:00.282352 11905 raft_consensus.cc:686] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [term 1 LEADER]: Becoming Leader. State: Replica: e29b55a8529848a2b427bf1335e1d68a, State: Running, Role: LEADER
I20260808 17:45:00.282488 11896 sys_catalog.cc:564] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:00.282488 11905 consensus_queue.cc:237] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29b55a8529848a2b427bf1335e1d68a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45677 } }
I20260808 17:45:00.282857 11905 sys_catalog.cc:455] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e29b55a8529848a2b427bf1335e1d68a. Latest consensus state: current_term: 1 leader_uuid: "e29b55a8529848a2b427bf1335e1d68a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29b55a8529848a2b427bf1335e1d68a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45677 } } }
I20260808 17:45:00.282931 11905 sys_catalog.cc:458] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:00.282912 11906 sys_catalog.cc:455] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e29b55a8529848a2b427bf1335e1d68a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e29b55a8529848a2b427bf1335e1d68a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45677 } } }
I20260808 17:45:00.282989 11906 sys_catalog.cc:458] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a [sys.catalog]: This master's current role is: LEADER
W20260808 17:45:00.284209 11929 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:45:00.284255 11929 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:45:00.284309 11910 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:00.284464 11910 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:00.285218 11901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:00.274471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:48877 (local address 127.0.0.1:45677)
0808 17:45:00.274634 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:00.274643 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:00.274669 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:45:00.275124 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:00.275131 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:00.275182 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:00.275293 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:00.276049 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:00.276918 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:00.277939 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:00.278406 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:00.278488 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:00.281147 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:00.281151 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:00.281151 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:00.281166 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:00.282998 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:00.283496 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:00.283499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:00.283499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:00.283606 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:00.283954 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:00.283955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:00.283956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:00.284279 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:00.284794 (+ 515us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:00.284908 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 17:45:00.285007 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260808 17:45:00.286051 11910 catalog_manager.cc:1347] Generated new cluster ID: 111c426b067c49ff8107c6354c9db60e
I20260808 17:45:00.286115 11910 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:00.286166 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:00.296046 11901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:00.290416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:37709 (local address 127.0.0.1:45677)
0808 17:45:00.290459 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:00.290461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:00.290569 (+ 108us) server_negotiation.cc:407] Connection header received
0808 17:45:00.290623 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:00.290624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:00.290634 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:00.290679 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:00.291160 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:00.291678 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:00.292345 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:00.292582 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:00.292636 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:00.293740 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:00.293742 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:00.293742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:00.293749 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:00.295019 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:00.295349 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:00.295350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:00.295351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:00.295402 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:00.295589 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:00.295589 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:00.295590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:00.295691 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:00.295783 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:00.295900 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 17:45:00.295959 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:45:00.298568 11910 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:00.299084 11910 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:00.304214 11910 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e29b55a8529848a2b427bf1335e1d68a: Generated new TSK 0
I20260808 17:45:00.304400 11910 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:00.313073 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 11782
W20260808 17:45:00.326789 11759 connection.cc:535] client connection to 127.0.0.1:45677 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45677): Connection reset by peer (error 104)
2026-08-08T17:45:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1482 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:00 dist-test-slave-bqcl krb5kdc[11940](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:00 dist-test-slave-bqcl krb5kdc[11940](info): set up 2 sockets
Aug 08 17:45:00 dist-test-slave-bqcl krb5kdc[11940](info): commencing operation
krb5kdc: starting...
W20260808 17:45:01.464362 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:01 dist-test-slave-bqcl krb5kdc[11940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:45:01.580135 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34267
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34267
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:01.660151 11962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:01.660367 11962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:01.660399 11962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:01.661543 11962 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:01.661590 11962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:01.661609 11962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:01.661625 11962 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:01.661640 11962 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:01.663092 11962 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34267
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:01.663334 11962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:01.663539 11962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:01.668192 11972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:01.668334 11962 server_base.cc:1034] running on GCE node
W20260808 17:45:01.668207 11974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:01.668215 11971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:01.668728 11962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:01.669008 11962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:01.670187 11962 hybrid_clock.cc:648] HybridClock initialized: now 1786211101670175 us; error 32 us; skew 500 ppm
Aug 08 17:45:01 dist-test-slave-bqcl krb5kdc[11940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211101, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:01.672648 11962 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:45:01.673110 11962 webserver.cc:460] Webserver started at http://127.0.0.1:44485/ using document root <none> and password file <none>
I20260808 17:45:01.673322 11962 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:01.673372 11962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:01.673507 11962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:01.674618 11962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "bc87e077359f42069eab5dbe8c6569ec"
format_stamp: "Formatted at 2026-08-08 17:45:01 on dist-test-slave-bqcl"
server_key: "23aef142ba121c41be6efeefea5236be"
server_key_iv: "308bc2b56cd45efa3858a47a2a8c7c59"
server_key_version: "encryptionkey@0"
I20260808 17:45:01.674968 11962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "bc87e077359f42069eab5dbe8c6569ec"
format_stamp: "Formatted at 2026-08-08 17:45:01 on dist-test-slave-bqcl"
server_key: "23aef142ba121c41be6efeefea5236be"
server_key_iv: "308bc2b56cd45efa3858a47a2a8c7c59"
server_key_version: "encryptionkey@0"
I20260808 17:45:01.676241 11962 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:45:01.676992 11989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:01.677160 11962 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:45:01.677254 11962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "bc87e077359f42069eab5dbe8c6569ec"
format_stamp: "Formatted at 2026-08-08 17:45:01 on dist-test-slave-bqcl"
server_key: "23aef142ba121c41be6efeefea5236be"
server_key_iv: "308bc2b56cd45efa3858a47a2a8c7c59"
server_key_version: "encryptionkey@0"
I20260808 17:45:01.677315 11962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:01.689954 11962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:01.691740 11962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:01.691877 11962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:01.695747 11962 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34267
I20260808 17:45:01.695788 12079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34267 every 8 connection(s)
I20260808 17:45:01.696121 11962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:01.697065 12081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:01.699249 12081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec: Bootstrap starting.
I20260808 17:45:01.699765 12081 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:01.699998 12081 log.cc:824] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:01.700645 12081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec: No bootstrap required, opened a new log
I20260808 17:45:01.702170 12081 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc87e077359f42069eab5dbe8c6569ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34267 } }
I20260808 17:45:01.702313 12081 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:01.702337 12081 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc87e077359f42069eab5dbe8c6569ec, State: Initialized, Role: FOLLOWER
I20260808 17:45:01.702441 12081 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc87e077359f42069eab5dbe8c6569ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34267 } }
I20260808 17:45:01.702515 12081 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:01.702536 12081 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:01.702566 12081 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:01.703003 12081 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc87e077359f42069eab5dbe8c6569ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34267 } }
I20260808 17:45:01.703087 12081 leader_election.cc:302] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc87e077359f42069eab5dbe8c6569ec; no voters:
I20260808 17:45:01.703204 12081 leader_election.cc:288] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:01.703258 12087 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:01.703419 12081 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:01.703434 12087 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [term 1 LEADER]: Becoming Leader. State: Replica: bc87e077359f42069eab5dbe8c6569ec, State: Running, Role: LEADER
I20260808 17:45:01.703586 12087 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc87e077359f42069eab5dbe8c6569ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34267 } }
I20260808 17:45:01.703984 12089 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc87e077359f42069eab5dbe8c6569ec. Latest consensus state: current_term: 1 leader_uuid: "bc87e077359f42069eab5dbe8c6569ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc87e077359f42069eab5dbe8c6569ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34267 } } }
I20260808 17:45:01.704021 12088 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc87e077359f42069eab5dbe8c6569ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc87e077359f42069eab5dbe8c6569ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34267 } } }
I20260808 17:45:01.704140 12089 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:01.704233 12088 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:01.704713 12102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:01.704711 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 11962
I20260808 17:45:01.704839 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:01.705078 9967 external_mini_cluster.cc:1428] Setting key 0984db689038366b9444d4c5c0781c94
I20260808 17:45:01.705317 12102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:01.706867 12102 catalog_manager.cc:1347] Generated new cluster ID: fb0813ce919943e1a0c377c3468f5c3e
I20260808 17:45:01.706929 12102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:01.711546 12116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:01.705749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:59717 (local address 127.0.0.1:34267)
0808 17:45:01.705941 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:01.705950 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:01.705986 (+ 36us) server_negotiation.cc:407] Connection header received
0808 17:45:01.706103 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:01.706110 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:01.706195 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:01.706474 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:01.706696 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:01.708094 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:01.709216 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:01.709845 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:01.709942 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:01.710658 (+ 716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:01.710662 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:01.710663 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:01.710871 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:01.710908 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:01.710922 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:01.711012 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:01.711122 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 17:45:01.711148 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":86,"threads_started":1}
I20260808 17:45:01.712415 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:01.717701 12116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:01.713831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:60193 (local address 127.0.0.1:34267)
0808 17:45:01.713866 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:01.713867 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:01.714160 (+ 293us) server_negotiation.cc:407] Connection header received
0808 17:45:01.714259 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:01.714260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:01.714272 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:01.714304 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:01.714504 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:01.715246 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:01.716273 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:01.716615 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:01.716654 (+ 39us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:01.717381 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:01.717382 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:01.717383 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:01.717387 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:01.717400 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:01.717404 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:01.717436 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:01.717614 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 17:45:01.717627 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:45:01.741173 12102 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:01.741972 12102 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:01.750895 12102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc87e077359f42069eab5dbe8c6569ec: Generated new TSK 0
I20260808 17:45:01.751102 12102 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:01.756992 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 11962
W20260808 17:45:01.773729 11938 connection.cc:535] client connection to 127.0.0.1:34267 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34267): Connection reset by peer (error 104)
2026-08-08T17:45:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1447 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:01 dist-test-slave-bqcl krb5kdc[12130](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:01 dist-test-slave-bqcl krb5kdc[12130](info): set up 2 sockets
Aug 08 17:45:01 dist-test-slave-bqcl krb5kdc[12130](info): commencing operation
krb5kdc: starting...
W20260808 17:45:02.929450 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:03 dist-test-slave-bqcl krb5kdc[12130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211103, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:45:03.048703 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34785
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:03.130241 12149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:03.130446 12149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:03.130467 12149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:03.131552 12149 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:03.131587 12149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:03.131598 12149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:03.131609 12149 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:03.131620 12149 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:03.133037 12149 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:03.133230 12149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:03.133404 12149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:03.138067 12156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:03.138232 12149 server_base.cc:1034] running on GCE node
W20260808 17:45:03.138147 12155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:03.138078 12158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:03.138604 12149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:03.138897 12149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:03.140039 12149 hybrid_clock.cc:648] HybridClock initialized: now 1786211103140013 us; error 38 us; skew 500 ppm
Aug 08 17:45:03 dist-test-slave-bqcl krb5kdc[12130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211103, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:03.145372 12149 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:45:03.145829 12149 webserver.cc:460] Webserver started at http://127.0.0.1:43201/ using document root <none> and password file <none>
I20260808 17:45:03.146102 12149 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:03.146188 12149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:03.146319 12149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:03.147362 12149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "49725b65c9744d8fb0bfda100e7148cf"
format_stamp: "Formatted at 2026-08-08 17:45:03 on dist-test-slave-bqcl"
server_key: "22e7036fc9eb8e2702a87f8b5d394683"
server_key_iv: "7c56e58d451f4d8a495ad2b2a03454d0"
server_key_version: "encryptionkey@0"
I20260808 17:45:03.147703 12149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "49725b65c9744d8fb0bfda100e7148cf"
format_stamp: "Formatted at 2026-08-08 17:45:03 on dist-test-slave-bqcl"
server_key: "22e7036fc9eb8e2702a87f8b5d394683"
server_key_iv: "7c56e58d451f4d8a495ad2b2a03454d0"
server_key_version: "encryptionkey@0"
I20260808 17:45:03.149032 12149 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:45:03.149798 12166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:03.149955 12149 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:45:03.150063 12149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "49725b65c9744d8fb0bfda100e7148cf"
format_stamp: "Formatted at 2026-08-08 17:45:03 on dist-test-slave-bqcl"
server_key: "22e7036fc9eb8e2702a87f8b5d394683"
server_key_iv: "7c56e58d451f4d8a495ad2b2a03454d0"
server_key_version: "encryptionkey@0"
I20260808 17:45:03.150152 12149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:03.153475 12149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:03.155412 12149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:03.155524 12149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:03.159313 12149 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34785
I20260808 17:45:03.159353 12248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34785 every 8 connection(s)
I20260808 17:45:03.159659 12149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:03.160626 12249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:03.162891 12249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf: Bootstrap starting.
I20260808 17:45:03.163359 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 12149
I20260808 17:45:03.163457 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:03.163481 12249 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:03.163636 9967 external_mini_cluster.cc:1428] Setting key 08cd2945e3c1a40d288255a177136ca9
I20260808 17:45:03.163748 12249 log.cc:824] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:03.164505 12249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf: No bootstrap required, opened a new log
I20260808 17:45:03.166039 12256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:03.164083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:47019 (local address 127.0.0.1:34785)
0808 17:45:03.164257 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:03.164266 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:03.164320 (+ 54us) server_negotiation.cc:407] Connection header received
0808 17:45:03.164872 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:03.164881 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:03.164916 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:03.165080 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:03.165625 (+ 545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:03.165628 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:03.165629 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:03.165633 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:03.165675 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:03.165690 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:03.165780 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:03.165809 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 17:45:03.165852 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":70,"threads_started":1}
I20260808 17:45:03.166915 12249 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49725b65c9744d8fb0bfda100e7148cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } }
I20260808 17:45:03.167043 12249 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:03.167086 12249 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49725b65c9744d8fb0bfda100e7148cf, State: Initialized, Role: FOLLOWER
I20260808 17:45:03.167132 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:03.167208 12249 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49725b65c9744d8fb0bfda100e7148cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } }
I20260808 17:45:03.167297 12249 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:03.167322 12249 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:03.167367 12249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:03.167865 12249 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49725b65c9744d8fb0bfda100e7148cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } }
I20260808 17:45:03.167951 12249 leader_election.cc:302] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49725b65c9744d8fb0bfda100e7148cf; no voters:
I20260808 17:45:03.168104 12249 leader_election.cc:288] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:03.168298 12262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:03.168314 12249 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:03.168475 12262 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [term 1 LEADER]: Becoming Leader. State: Replica: 49725b65c9744d8fb0bfda100e7148cf, State: Running, Role: LEADER
I20260808 17:45:03.168602 12262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49725b65c9744d8fb0bfda100e7148cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } }
I20260808 17:45:03.168949 12262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49725b65c9744d8fb0bfda100e7148cf. Latest consensus state: current_term: 1 leader_uuid: "49725b65c9744d8fb0bfda100e7148cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49725b65c9744d8fb0bfda100e7148cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } } }
I20260808 17:45:03.169032 12262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:03.169044 12268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49725b65c9744d8fb0bfda100e7148cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49725b65c9744d8fb0bfda100e7148cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } } }
I20260808 17:45:03.169134 12268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:03.169272 12281 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:03.169808 12281 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:03.170112 12256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:03.168626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:50315 (local address 127.0.0.1:34785)
0808 17:45:03.168656 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:03.168658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:03.168804 (+ 146us) server_negotiation.cc:407] Connection header received
0808 17:45:03.168903 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:03.168904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:03.168909 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:03.168981 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:03.169850 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:03.169851 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:03.169852 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:03.169856 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:03.169870 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:03.169874 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:03.169922 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:03.170037 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 17:45:03.170052 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:45:03.171705 12281 catalog_manager.cc:1347] Generated new cluster ID: 6bac4f10d5714df5b681013013d8e9e8
I20260808 17:45:03.171763 12281 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:03.186919 12281 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:03.187089 12281 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:03.192739 12281 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49725b65c9744d8fb0bfda100e7148cf: Generated new TSK 0
I20260808 17:45:03.192905 12281 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:03.198170 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 12149
2026-08-08T17:45:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1436 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:03 dist-test-slave-bqcl krb5kdc[12296](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:03 dist-test-slave-bqcl krb5kdc[12296](info): set up 2 sockets
Aug 08 17:45:03 dist-test-slave-bqcl krb5kdc[12296](info): commencing operation
krb5kdc: starting...
W20260808 17:45:04.352460 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:04 dist-test-slave-bqcl krb5kdc[12296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:45:04.471076 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40981
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:04.554510 12311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:04.554731 12311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:04.554764 12311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:04.555928 12311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:04.555971 12311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:04.555990 12311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:04.556005 12311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:04.556020 12311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:04.557523 12311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40981
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:04.557762 12311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:04.557957 12311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:04.562633 12321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:04.562628 12318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:04.562676 12319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:04.562867 12311 server_base.cc:1034] running on GCE node
I20260808 17:45:04.563192 12311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:04.563467 12311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:04.564618 12311 hybrid_clock.cc:648] HybridClock initialized: now 1786211104564604 us; error 30 us; skew 500 ppm
Aug 08 17:45:04 dist-test-slave-bqcl krb5kdc[12296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211104, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:04.567180 12311 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:45:04.567579 12311 webserver.cc:460] Webserver started at http://127.0.0.1:35227/ using document root <none> and password file <none>
I20260808 17:45:04.567754 12311 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:04.567793 12311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:04.567878 12311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:04.568851 12311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "d93d522f75c1467793c36ad703029a98"
format_stamp: "Formatted at 2026-08-08 17:45:04 on dist-test-slave-bqcl"
server_key: "1d4d1142da1e19bbc39718bf1bac4527"
server_key_iv: "701feafbe10a49eee7a013bf98ddf485"
server_key_version: "encryptionkey@0"
I20260808 17:45:04.569159 12311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "d93d522f75c1467793c36ad703029a98"
format_stamp: "Formatted at 2026-08-08 17:45:04 on dist-test-slave-bqcl"
server_key: "1d4d1142da1e19bbc39718bf1bac4527"
server_key_iv: "701feafbe10a49eee7a013bf98ddf485"
server_key_version: "encryptionkey@0"
I20260808 17:45:04.570363 12311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:45:04.571024 12331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:04.571184 12311 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:04.571275 12311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "d93d522f75c1467793c36ad703029a98"
format_stamp: "Formatted at 2026-08-08 17:45:04 on dist-test-slave-bqcl"
server_key: "1d4d1142da1e19bbc39718bf1bac4527"
server_key_iv: "701feafbe10a49eee7a013bf98ddf485"
server_key_version: "encryptionkey@0"
I20260808 17:45:04.571327 12311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:04.581809 12311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:04.583611 12311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:04.583712 12311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:04.587416 12311 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40981
I20260808 17:45:04.587458 12413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40981 every 8 connection(s)
I20260808 17:45:04.587749 12311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:04.588738 12414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:04.591028 12414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98: Bootstrap starting.
I20260808 17:45:04.591593 12414 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:04.591852 12414 log.cc:824] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:04.592489 12414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98: No bootstrap required, opened a new log
I20260808 17:45:04.594008 12414 raft_consensus.cc:348] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93d522f75c1467793c36ad703029a98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40981 } }
I20260808 17:45:04.594177 12414 raft_consensus.cc:374] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:04.594213 12414 raft_consensus.cc:729] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d93d522f75c1467793c36ad703029a98, State: Initialized, Role: FOLLOWER
I20260808 17:45:04.594347 12414 consensus_queue.cc:260] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93d522f75c1467793c36ad703029a98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40981 } }
I20260808 17:45:04.594409 12414 raft_consensus.cc:388] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:04.594439 12414 raft_consensus.cc:482] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:04.594489 12414 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:04.594974 12414 raft_consensus.cc:504] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93d522f75c1467793c36ad703029a98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40981 } }
I20260808 17:45:04.595075 12414 leader_election.cc:302] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d93d522f75c1467793c36ad703029a98; no voters:
I20260808 17:45:04.595224 12414 leader_election.cc:288] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:04.595253 12420 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:04.595398 12420 raft_consensus.cc:686] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [term 1 LEADER]: Becoming Leader. State: Replica: d93d522f75c1467793c36ad703029a98, State: Running, Role: LEADER
I20260808 17:45:04.595458 12414 sys_catalog.cc:564] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:04.595486 12420 consensus_queue.cc:237] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93d522f75c1467793c36ad703029a98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40981 } }
I20260808 17:45:04.595795 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 12311
I20260808 17:45:04.595912 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:04.596108 9967 external_mini_cluster.cc:1428] Setting key 37673b68f0343391e9bd329531866f0d
I20260808 17:45:04.596189 12421 sys_catalog.cc:455] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d93d522f75c1467793c36ad703029a98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93d522f75c1467793c36ad703029a98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40981 } } }
I20260808 17:45:04.596263 12421 sys_catalog.cc:458] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:04.596419 12422 sys_catalog.cc:455] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d93d522f75c1467793c36ad703029a98. Latest consensus state: current_term: 1 leader_uuid: "d93d522f75c1467793c36ad703029a98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d93d522f75c1467793c36ad703029a98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40981 } } }
I20260808 17:45:04.596470 12422 sys_catalog.cc:458] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98 [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:04.596652 12435 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:04.597168 12435 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:04.600005 12435 catalog_manager.cc:1347] Generated new cluster ID: 832c00e43fc447338186700213ef6690
I20260808 17:45:04.600071 12435 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:45:04 dist-test-slave-bqcl krb5kdc[12296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 17:45:04.606631 12441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:04.596707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:33787 (local address 127.0.0.1:40981)
0808 17:45:04.597145 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:04.597155 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:04.597188 (+ 33us) server_negotiation.cc:407] Connection header received
0808 17:45:04.597303 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:04.597310 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:04.597368 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:04.597537 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:04.598256 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:04.599579 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:04.600421 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:04.600860 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:04.600956 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:04.603176 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:04.603180 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:04.603181 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:04.603192 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:04.605146 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:04.605514 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:04.605518 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:04.605518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:04.605613 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:04.605817 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:04.605818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:04.605818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:04.606046 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:04.606221 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:04.606344 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 17:45:04.606442 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":68,"threads_started":1}
I20260808 17:45:04.607525 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:04.614464 12441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:04.608797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:35397 (local address 127.0.0.1:40981)
0808 17:45:04.608830 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:04.608832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:04.608929 (+ 97us) server_negotiation.cc:407] Connection header received
0808 17:45:04.608983 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:04.608984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:04.608993 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:04.609044 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:04.609488 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:04.609988 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:04.610702 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:04.610912 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:04.610967 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:04.612002 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:04.612003 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:04.612004 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:04.612010 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:04.613206 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:04.613532 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:04.613533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:04.613533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:04.613587 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:04.613781 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:04.613782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:04.613782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:04.613883 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:04.613974 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:04.614255 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 17:45:04.614344 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:45:04.622493 12435 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:04.622963 12435 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:04.627336 12435 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d93d522f75c1467793c36ad703029a98: Generated new TSK 0
I20260808 17:45:04.627508 12435 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:04.637369 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 12311
W20260808 17:45:04.648422 12293 connection.cc:535] client connection to 127.0.0.1:40981 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40981): Connection reset by peer (error 104)
2026-08-08T17:45:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1438 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:04 dist-test-slave-bqcl krb5kdc[12466](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:04 dist-test-slave-bqcl krb5kdc[12466](info): set up 2 sockets
Aug 08 17:45:04 dist-test-slave-bqcl krb5kdc[12466](info): commencing operation
krb5kdc: starting...
W20260808 17:45:05.795044 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:05 dist-test-slave-bqcl krb5kdc[12466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211105, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:45:05.910949 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36205
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36205
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:05.992340 12488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:05.992539 12488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:05.992569 12488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:05.993682 12488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:05.993724 12488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:05.993737 12488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:05.993748 12488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:05.993759 12488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:05.995294 12488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36205
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:05.995538 12488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:05.995756 12488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:06.000478 12496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:06.000473 12498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:06.000468 12493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:06.000818 12488 server_base.cc:1034] running on GCE node
I20260808 17:45:06.001034 12488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:06.001308 12488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:06.002436 12488 hybrid_clock.cc:648] HybridClock initialized: now 1786211106002425 us; error 27 us; skew 500 ppm
Aug 08 17:45:06 dist-test-slave-bqcl krb5kdc[12466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211106, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:06.004840 12488 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:45:06.005326 12488 webserver.cc:460] Webserver started at http://127.0.0.1:42693/ using document root <none> and password file <none>
I20260808 17:45:06.005538 12488 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:06.005589 12488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:06.005717 12488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:06.006883 12488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "c05373df5b114c8487b21e4c9c31d56f"
format_stamp: "Formatted at 2026-08-08 17:45:06 on dist-test-slave-bqcl"
server_key: "5233bdf287f96a3be7d1b044334b6527"
server_key_iv: "9a3e3ea9e187835a68f39c4fd10fbc07"
server_key_version: "encryptionkey@0"
I20260808 17:45:06.007217 12488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "c05373df5b114c8487b21e4c9c31d56f"
format_stamp: "Formatted at 2026-08-08 17:45:06 on dist-test-slave-bqcl"
server_key: "5233bdf287f96a3be7d1b044334b6527"
server_key_iv: "9a3e3ea9e187835a68f39c4fd10fbc07"
server_key_version: "encryptionkey@0"
I20260808 17:45:06.008477 12488 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:45:06.009126 12506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:06.009286 12488 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:45:06.009377 12488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "c05373df5b114c8487b21e4c9c31d56f"
format_stamp: "Formatted at 2026-08-08 17:45:06 on dist-test-slave-bqcl"
server_key: "5233bdf287f96a3be7d1b044334b6527"
server_key_iv: "9a3e3ea9e187835a68f39c4fd10fbc07"
server_key_version: "encryptionkey@0"
I20260808 17:45:06.009436 12488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:06.031371 12488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:06.033252 12488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:06.033394 12488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:06.037545 12488 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36205
I20260808 17:45:06.037626 12587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36205 every 8 connection(s)
I20260808 17:45:06.037937 12488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:06.038805 12589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:06.041072 12589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f: Bootstrap starting.
I20260808 17:45:06.041605 12589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:06.041847 12589 log.cc:824] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:06.042490 12589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f: No bootstrap required, opened a new log
I20260808 17:45:06.044024 12589 raft_consensus.cc:348] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c05373df5b114c8487b21e4c9c31d56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36205 } }
I20260808 17:45:06.044159 12589 raft_consensus.cc:374] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:06.044179 12589 raft_consensus.cc:729] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c05373df5b114c8487b21e4c9c31d56f, State: Initialized, Role: FOLLOWER
I20260808 17:45:06.044286 12589 consensus_queue.cc:260] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c05373df5b114c8487b21e4c9c31d56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36205 } }
I20260808 17:45:06.044338 12589 raft_consensus.cc:388] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:06.044358 12589 raft_consensus.cc:482] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:06.044389 12589 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:06.044858 12589 raft_consensus.cc:504] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c05373df5b114c8487b21e4c9c31d56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36205 } }
I20260808 17:45:06.044942 12589 leader_election.cc:302] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c05373df5b114c8487b21e4c9c31d56f; no voters:
I20260808 17:45:06.045079 12589 leader_election.cc:288] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:06.045121 12593 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:06.045310 12589 sys_catalog.cc:564] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:06.045327 12593 raft_consensus.cc:686] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [term 1 LEADER]: Becoming Leader. State: Replica: c05373df5b114c8487b21e4c9c31d56f, State: Running, Role: LEADER
I20260808 17:45:06.045467 12593 consensus_queue.cc:237] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c05373df5b114c8487b21e4c9c31d56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36205 } }
I20260808 17:45:06.045809 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 12488
I20260808 17:45:06.045948 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:06.046015 12596 sys_catalog.cc:455] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c05373df5b114c8487b21e4c9c31d56f. Latest consensus state: current_term: 1 leader_uuid: "c05373df5b114c8487b21e4c9c31d56f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c05373df5b114c8487b21e4c9c31d56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36205 } } }
I20260808 17:45:06.046087 12596 sys_catalog.cc:458] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:06.046173 9967 external_mini_cluster.cc:1428] Setting key 781997d8add34011cdfb9a6e19614f0d
I20260808 17:45:06.046334 12595 sys_catalog.cc:455] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c05373df5b114c8487b21e4c9c31d56f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c05373df5b114c8487b21e4c9c31d56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36205 } } }
I20260808 17:45:06.046425 12595 sys_catalog.cc:458] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:06.046681 12613 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:06.047222 12613 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:06.048692 12613 catalog_manager.cc:1347] Generated new cluster ID: 8f1d439925ef4d13a991411f8535ab9e
I20260808 17:45:06.048745 12613 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:06.052311 12618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:06.046834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:42941 (local address 127.0.0.1:36205)
0808 17:45:06.047093 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:06.047102 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:06.047140 (+ 38us) server_negotiation.cc:407] Connection header received
0808 17:45:06.047259 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:06.047266 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:06.047324 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:06.047471 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:06.047691 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:06.049011 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:06.050095 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:06.050735 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:06.050869 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:06.051598 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:06.051603 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:06.051603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:06.051815 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:06.051854 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:06.051869 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:06.051951 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:06.052049 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 17:45:06.052077 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":58,"threads_started":1}
I20260808 17:45:06.053273 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:06.059357 12618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:06.054703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:40875 (local address 127.0.0.1:36205)
0808 17:45:06.054745 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:06.054747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:06.055938 (+ 1191us) server_negotiation.cc:407] Connection header received
0808 17:45:06.055995 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:06.055996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:06.056026 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:06.056089 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:06.056208 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:06.056974 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:06.057935 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:06.058287 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:06.058354 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:06.058985 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:06.058986 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:06.058987 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:06.058991 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:06.059007 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:06.059012 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:06.059139 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:06.059265 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 17:45:06.059278 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:45:06.071410 12613 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:06.071914 12613 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:06.084683 12613 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c05373df5b114c8487b21e4c9c31d56f: Generated new TSK 0
I20260808 17:45:06.084879 12613 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:06.089838 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 12488
W20260808 17:45:06.101092 12463 connection.cc:535] client connection to 127.0.0.1:36205 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36205): Connection reset by peer (error 104)
2026-08-08T17:45:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1452 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:06 dist-test-slave-bqcl krb5kdc[12635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:06 dist-test-slave-bqcl krb5kdc[12635](info): set up 2 sockets
Aug 08 17:45:06 dist-test-slave-bqcl krb5kdc[12635](info): commencing operation
krb5kdc: starting...
W20260808 17:45:07.244736 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:07 dist-test-slave-bqcl krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211107, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:45:07.362380 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38801
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:07.443392 12654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:07.443621 12654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:07.443652 12654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:07.444782 12654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:07.444826 12654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:07.444845 12654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:07.444861 12654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:07.444875 12654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:07.446372 12654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38801
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:07.446623 12654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:07.446833 12654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:07.451498 12662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:07.451501 12666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:07.451522 12663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:07.451771 12654 server_base.cc:1034] running on GCE node
I20260808 17:45:07.452056 12654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:07.452353 12654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:07.453509 12654 hybrid_clock.cc:648] HybridClock initialized: now 1786211107453488 us; error 28 us; skew 500 ppm
Aug 08 17:45:07 dist-test-slave-bqcl krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211107, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:07.456043 12654 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:45:07.456480 12654 webserver.cc:460] Webserver started at http://127.0.0.1:34297/ using document root <none> and password file <none>
I20260808 17:45:07.456684 12654 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:07.456733 12654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:07.456861 12654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:07.457928 12654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "1a0107844d1c4ed587f5a6a59f748953"
format_stamp: "Formatted at 2026-08-08 17:45:07 on dist-test-slave-bqcl"
server_key: "1b5c7449812126020e5a85a0e835ea20"
server_key_iv: "db08ab7edb51d8334f51b20fde7834da"
server_key_version: "encryptionkey@0"
I20260808 17:45:07.458321 12654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "1a0107844d1c4ed587f5a6a59f748953"
format_stamp: "Formatted at 2026-08-08 17:45:07 on dist-test-slave-bqcl"
server_key: "1b5c7449812126020e5a85a0e835ea20"
server_key_iv: "db08ab7edb51d8334f51b20fde7834da"
server_key_version: "encryptionkey@0"
I20260808 17:45:07.459591 12654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:45:07.460312 12677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:07.460450 12654 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:45:07.460536 12654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "1a0107844d1c4ed587f5a6a59f748953"
format_stamp: "Formatted at 2026-08-08 17:45:07 on dist-test-slave-bqcl"
server_key: "1b5c7449812126020e5a85a0e835ea20"
server_key_iv: "db08ab7edb51d8334f51b20fde7834da"
server_key_version: "encryptionkey@0"
I20260808 17:45:07.460598 12654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:07.463864 12654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:07.465721 12654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:07.465845 12654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:07.469779 12654 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38801
I20260808 17:45:07.469817 12751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38801 every 8 connection(s)
I20260808 17:45:07.470157 12654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:07.471148 12752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:07.473348 12752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953: Bootstrap starting.
I20260808 17:45:07.473868 12752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:07.474117 12752 log.cc:824] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:07.474794 12752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953: No bootstrap required, opened a new log
I20260808 17:45:07.476315 12752 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0107844d1c4ed587f5a6a59f748953" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38801 } }
I20260808 17:45:07.476457 12752 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:07.476478 12752 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0107844d1c4ed587f5a6a59f748953, State: Initialized, Role: FOLLOWER
I20260808 17:45:07.476591 12752 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0107844d1c4ed587f5a6a59f748953" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38801 } }
I20260808 17:45:07.476667 12752 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:07.476691 12752 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:07.476723 12752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:07.476979 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 12654
I20260808 17:45:07.477104 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:07.477264 12752 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0107844d1c4ed587f5a6a59f748953" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38801 } }
I20260808 17:45:07.477293 9967 external_mini_cluster.cc:1428] Setting key 31765e63ab0b0c282470af8ac21fc00a
I20260808 17:45:07.477358 12752 leader_election.cc:302] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a0107844d1c4ed587f5a6a59f748953; no voters:
I20260808 17:45:07.477512 12752 leader_election.cc:288] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:07.477550 12758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:07.477682 12758 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0107844d1c4ed587f5a6a59f748953, State: Running, Role: LEADER
I20260808 17:45:07.477777 12752 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:07.477829 12758 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0107844d1c4ed587f5a6a59f748953" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38801 } }
I20260808 17:45:07.478227 12758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a0107844d1c4ed587f5a6a59f748953. Latest consensus state: current_term: 1 leader_uuid: "1a0107844d1c4ed587f5a6a59f748953" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0107844d1c4ed587f5a6a59f748953" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38801 } } }
I20260808 17:45:07.478231 12762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a0107844d1c4ed587f5a6a59f748953" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0107844d1c4ed587f5a6a59f748953" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38801 } } }
I20260808 17:45:07.478375 12758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:07.478423 12762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953 [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:07.478896 12769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:07.479496 12769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:07.480793 12764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:07.477918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:58653 (local address 127.0.0.1:38801)
0808 17:45:07.478720 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:07.478732 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:07.479041 (+ 309us) server_negotiation.cc:407] Connection header received
0808 17:45:07.479168 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:07.479173 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:07.479195 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:07.479323 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:07.480315 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:07.480319 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:07.480319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:07.480323 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:07.480364 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:07.480387 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:07.480448 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:07.480568 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 17:45:07.480619 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":75,"threads_started":1}
I20260808 17:45:07.481850 12769 catalog_manager.cc:1347] Generated new cluster ID: afe461d1cab741ada8c863d04a2a94d9
I20260808 17:45:07.481905 12769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:07.482837 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:07.495644 12764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:07.494496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.178:60927 (local address 127.0.0.1:38801)
0808 17:45:07.494554 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:07.494557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:07.494693 (+ 136us) server_negotiation.cc:407] Connection header received
0808 17:45:07.494751 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:07.494752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:07.494758 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:07.494812 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:07.495386 (+ 574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:07.495387 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:07.495388 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:07.495392 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:07.495407 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:07.495412 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:07.495460 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:07.495508 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 17:45:07.495523 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 17:45:07.496426 12769 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:07.496593 12769 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:07.509783 12769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a0107844d1c4ed587f5a6a59f748953: Generated new TSK 0
I20260808 17:45:07.509995 12769 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:07.515941 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 12654
2026-08-08T17:45:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1442 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:07 dist-test-slave-bqcl krb5kdc[12798](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:07 dist-test-slave-bqcl krb5kdc[12798](info): set up 2 sockets
Aug 08 17:45:07 dist-test-slave-bqcl krb5kdc[12798](info): commencing operation
krb5kdc: starting...
W20260808 17:45:08.679838 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:08 dist-test-slave-bqcl krb5kdc[12798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:45:08.800441 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:34583
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:44103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:34583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:08.880755 12828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:08.880944 12828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:08.880964 12828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:08.882061 12828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:08.882102 12828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:08.882114 12828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:08.882158 12828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:08.882192 12828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:08.883627 12828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:44103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:34583
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:34583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:08.883833 12828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:08.884034 12828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:08.888523 12838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:08.888522 12834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:08.888530 12835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:08.888969 12828 server_base.cc:1034] running on GCE node
I20260808 17:45:08.889209 12828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:08.889453 12828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:08.890587 12828 hybrid_clock.cc:648] HybridClock initialized: now 1786211108890572 us; error 30 us; skew 500 ppm
Aug 08 17:45:08 dist-test-slave-bqcl krb5kdc[12798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211108, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:08.896968 12828 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:45:08.897433 12828 webserver.cc:460] Webserver started at http://127.9.187.254:36081/ using document root <none> and password file <none>
I20260808 17:45:08.897660 12828 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:08.897706 12828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:08.897812 12828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:08.898919 12828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "65461f38e5fd41c0bfd2794b551babfd"
format_stamp: "Formatted at 2026-08-08 17:45:08 on dist-test-slave-bqcl"
server_key: "e4147e65b6972ae2b8ed2a05518cc818"
server_key_iv: "bc8eaf071d99582e2ef31a7d7ab3875c"
server_key_version: "encryptionkey@0"
I20260808 17:45:08.899248 12828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "65461f38e5fd41c0bfd2794b551babfd"
format_stamp: "Formatted at 2026-08-08 17:45:08 on dist-test-slave-bqcl"
server_key: "e4147e65b6972ae2b8ed2a05518cc818"
server_key_iv: "bc8eaf071d99582e2ef31a7d7ab3875c"
server_key_version: "encryptionkey@0"
I20260808 17:45:08.900504 12828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:45:08.901221 12852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:08.901376 12828 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:45:08.901455 12828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "65461f38e5fd41c0bfd2794b551babfd"
format_stamp: "Formatted at 2026-08-08 17:45:08 on dist-test-slave-bqcl"
server_key: "e4147e65b6972ae2b8ed2a05518cc818"
server_key_iv: "bc8eaf071d99582e2ef31a7d7ab3875c"
server_key_version: "encryptionkey@0"
I20260808 17:45:08.901520 12828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:08.918111 12828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:08.919857 12828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:08.919979 12828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:08.923982 12828 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:34583
I20260808 17:45:08.924036 12934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:34583 every 8 connection(s)
I20260808 17:45:08.924340 12828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:08.925073 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 12828
I20260808 17:45:08.925184 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:08.925276 12936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:08.925370 9967 external_mini_cluster.cc:1428] Setting key ce3e544f9cbd00c892c7002f7ba6e232
I20260808 17:45:08.928573 12936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd: Bootstrap starting.
I20260808 17:45:08.929247 12936 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:08.929514 12936 log.cc:824] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:08.930225 12936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd: No bootstrap required, opened a new log
I20260808 17:45:08.932137 12936 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65461f38e5fd41c0bfd2794b551babfd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34583 } }
Aug 08 17:45:08 dist-test-slave-bqcl krb5kdc[12798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:45:08.932304 12936 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:08.932340 12936 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65461f38e5fd41c0bfd2794b551babfd, State: Initialized, Role: FOLLOWER
I20260808 17:45:08.932467 12936 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65461f38e5fd41c0bfd2794b551babfd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34583 } }
I20260808 17:45:08.932550 12936 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:08.932601 12936 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:08.932649 12936 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:08.933171 12936 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65461f38e5fd41c0bfd2794b551babfd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34583 } }
I20260808 17:45:08.933271 12936 leader_election.cc:302] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65461f38e5fd41c0bfd2794b551babfd; no voters:
I20260808 17:45:08.933418 12936 leader_election.cc:288] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:08.933465 12946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:08.933609 12946 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [term 1 LEADER]: Becoming Leader. State: Replica: 65461f38e5fd41c0bfd2794b551babfd, State: Running, Role: LEADER
I20260808 17:45:08.933671 12936 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:08.933967 12946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65461f38e5fd41c0bfd2794b551babfd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34583 } }
I20260808 17:45:08.934369 12949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65461f38e5fd41c0bfd2794b551babfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65461f38e5fd41c0bfd2794b551babfd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34583 } } }
I20260808 17:45:08.934598 12949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:08.934525 12948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65461f38e5fd41c0bfd2794b551babfd. Latest consensus state: current_term: 1 leader_uuid: "65461f38e5fd41c0bfd2794b551babfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65461f38e5fd41c0bfd2794b551babfd" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34583 } } }
I20260808 17:45:08.935104 12967 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:08.935725 12967 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:08.935106 12948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:08.936554 12941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:08.925863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37939 (local address 127.9.187.254:34583)
0808 17:45:08.926062 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:08.926072 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:08.926107 (+ 35us) server_negotiation.cc:407] Connection header received
0808 17:45:08.926819 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:08.926829 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:08.926895 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:08.927040 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:08.927631 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:08.928993 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:08.929781 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:08.930303 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:08.930412 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:08.932841 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:08.932844 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:08.932844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:08.932854 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:08.934792 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:08.935265 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:08.935268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:08.935269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:08.935378 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:08.935619 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:08.935620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:08.935621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:08.935933 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:08.936091 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:08.936258 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 17:45:08.936362 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":89,"threads_started":1}
I20260808 17:45:08.937435 12967 catalog_manager.cc:1347] Generated new cluster ID: baf651f587dc48a08d95376230d6aed8
I20260808 17:45:08.937484 12967 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:08.937693 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:08.945884 12941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:08.939201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43289 (local address 127.9.187.254:34583)
0808 17:45:08.939234 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:08.939236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:08.939289 (+ 53us) server_negotiation.cc:407] Connection header received
0808 17:45:08.939351 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:08.939352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:08.939360 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:08.939404 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:08.940000 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:08.940704 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:08.941688 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:08.941989 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:08.942039 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:08.943313 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:08.943314 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:08.943315 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:08.943319 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:08.944763 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:08.945157 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:08.945157 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:08.945158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:08.945208 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:08.945422 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:08.945423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:08.945423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:08.945527 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:08.945619 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:08.945748 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 17:45:08.945802 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:45:08.954805 12967 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:08.955269 12967 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:08.964545 12967 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65461f38e5fd41c0bfd2794b551babfd: Generated new TSK 0
I20260808 17:45:08.964701 12967 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:08.967119 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 12828
W20260808 17:45:08.982870 12796 connection.cc:535] client connection to 127.9.187.254:34583 recv error: Network error: failed to read from TLS socket (remote: 127.9.187.254:34583): Connection reset by peer (error 104)
2026-08-08T17:45:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1439 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:09 dist-test-slave-bqcl krb5kdc[13003](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:09 dist-test-slave-bqcl krb5kdc[13003](info): set up 2 sockets
Aug 08 17:45:09 dist-test-slave-bqcl krb5kdc[13003](info): commencing operation
krb5kdc: starting...
W20260808 17:45:10.129074 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:10 dist-test-slave-bqcl krb5kdc[13003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211110, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:45:10.246147 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:42815
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:43105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:42815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:10.326252 13025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:10.326447 13025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:10.326468 13025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:10.327525 13025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:10.327567 13025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:10.327581 13025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:10.327592 13025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:10.327603 13025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:10.328974 13025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:43105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:42815
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:42815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:10.329157 13025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:10.329324 13025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:10.333755 13033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:10.333830 13036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:10.333760 13032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:10.333984 13025 server_base.cc:1034] running on GCE node
I20260808 17:45:10.334266 13025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:10.334548 13025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:10.335692 13025 hybrid_clock.cc:648] HybridClock initialized: now 1786211110335671 us; error 34 us; skew 500 ppm
Aug 08 17:45:10 dist-test-slave-bqcl krb5kdc[13003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211110, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:10.338008 13025 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:45:10.338531 13025 webserver.cc:460] Webserver started at http://127.9.187.254:43739/ using document root <none> and password file <none>
I20260808 17:45:10.338773 13025 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:10.338837 13025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:10.338973 13025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:10.340036 13025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "c422eb3eb9b8452fb325cad4447302ec"
format_stamp: "Formatted at 2026-08-08 17:45:10 on dist-test-slave-bqcl"
server_key: "2cf50aa4a643fbe59ffbf74d47db7d31"
server_key_iv: "107fdc26d2724d7e7b91711c7607b578"
server_key_version: "encryptionkey@0"
I20260808 17:45:10.340342 13025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "c422eb3eb9b8452fb325cad4447302ec"
format_stamp: "Formatted at 2026-08-08 17:45:10 on dist-test-slave-bqcl"
server_key: "2cf50aa4a643fbe59ffbf74d47db7d31"
server_key_iv: "107fdc26d2724d7e7b91711c7607b578"
server_key_version: "encryptionkey@0"
I20260808 17:45:10.341504 13025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:45:10.342090 13048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:10.342249 13025 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:10.342326 13025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "c422eb3eb9b8452fb325cad4447302ec"
format_stamp: "Formatted at 2026-08-08 17:45:10 on dist-test-slave-bqcl"
server_key: "2cf50aa4a643fbe59ffbf74d47db7d31"
server_key_iv: "107fdc26d2724d7e7b91711c7607b578"
server_key_version: "encryptionkey@0"
I20260808 17:45:10.342389 13025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:10.348683 13025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:10.350373 13025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:10.350510 13025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:10.354140 13025 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:42815
I20260808 17:45:10.354197 13133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:42815 every 8 connection(s)
I20260808 17:45:10.354517 13025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:10.355346 13146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:10.357503 13146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec: Bootstrap starting.
I20260808 17:45:10.358049 13146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:10.358345 13146 log.cc:824] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:10.359018 13146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec: No bootstrap required, opened a new log
I20260808 17:45:10.360563 13146 raft_consensus.cc:348] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c422eb3eb9b8452fb325cad4447302ec" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42815 } }
I20260808 17:45:10.360723 13146 raft_consensus.cc:374] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:10.360775 13146 raft_consensus.cc:729] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c422eb3eb9b8452fb325cad4447302ec, State: Initialized, Role: FOLLOWER
I20260808 17:45:10.360821 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 13025
I20260808 17:45:10.360944 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:10.360927 13146 consensus_queue.cc:260] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c422eb3eb9b8452fb325cad4447302ec" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42815 } }
I20260808 17:45:10.360998 13146 raft_consensus.cc:388] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:10.361038 13146 raft_consensus.cc:482] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:10.361095 13146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:10.361142 9967 external_mini_cluster.cc:1428] Setting key 06df208e8c69d1cfb5d1dd676df1571b
I20260808 17:45:10.362020 13146 raft_consensus.cc:504] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c422eb3eb9b8452fb325cad4447302ec" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42815 } }
I20260808 17:45:10.362169 13146 leader_election.cc:302] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c422eb3eb9b8452fb325cad4447302ec; no voters:
I20260808 17:45:10.362336 13146 leader_election.cc:288] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:10.362362 13154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:10.362546 13154 raft_consensus.cc:686] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [term 1 LEADER]: Becoming Leader. State: Replica: c422eb3eb9b8452fb325cad4447302ec, State: Running, Role: LEADER
I20260808 17:45:10.362589 13146 sys_catalog.cc:564] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:10.362646 13154 consensus_queue.cc:237] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c422eb3eb9b8452fb325cad4447302ec" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42815 } }
I20260808 17:45:10.363010 13154 sys_catalog.cc:455] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader c422eb3eb9b8452fb325cad4447302ec. Latest consensus state: current_term: 1 leader_uuid: "c422eb3eb9b8452fb325cad4447302ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c422eb3eb9b8452fb325cad4447302ec" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42815 } } }
I20260808 17:45:10.363142 13154 sys_catalog.cc:458] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:10.363117 13156 sys_catalog.cc:455] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c422eb3eb9b8452fb325cad4447302ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c422eb3eb9b8452fb325cad4447302ec" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 42815 } } }
I20260808 17:45:10.363231 13156 sys_catalog.cc:458] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec [sys.catalog]: This master's current role is: LEADER
W20260808 17:45:10.364416 13177 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:45:10.364460 13177 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:45:10.364501 13165 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:10.364642 13165 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:10.366402 13165 catalog_manager.cc:1347] Generated new cluster ID: 71244dead74448b6909a91be1a98327f
I20260808 17:45:10.366458 13165 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:10.366904 13153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:10.361610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46803 (local address 127.9.187.254:42815)
0808 17:45:10.361793 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:10.361801 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:10.361826 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:45:10.361917 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:10.361922 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:10.361962 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:10.362065 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:10.362325 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:10.363785 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:10.364810 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:10.365388 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:10.365491 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:10.366207 (+ 716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:10.366210 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:10.366211 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:10.366396 (+ 185us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:10.366435 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:10.366447 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:10.366567 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:10.366655 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 17:45:10.366682 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260808 17:45:10.371129 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:10.380870 13165 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:10.380970 13153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:10.372400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46955 (local address 127.9.187.254:42815)
0808 17:45:10.372438 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:10.372440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:10.378280 (+ 5840us) server_negotiation.cc:407] Connection header received
0808 17:45:10.378354 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:10.378354 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:10.378364 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:10.378411 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:10.378533 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:10.379008 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:10.379690 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:10.379901 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:10.379953 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:10.380587 (+ 634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:10.380588 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:10.380589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:10.380593 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:10.380610 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:10.380615 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:10.380676 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:10.380774 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 17:45:10.380865 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:45:10.381485 13165 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:10.384979 13165 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c422eb3eb9b8452fb325cad4447302ec: Generated new TSK 0
I20260808 17:45:10.385133 13165 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:10.388398 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 13025
W20260808 17:45:10.395702 12999 connection.cc:535] client connection to 127.9.187.254:42815 recv error: Network error: failed to read from TLS socket (remote: 127.9.187.254:42815): Connection reset by peer (error 104)
2026-08-08T17:45:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1412 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:10 dist-test-slave-bqcl krb5kdc[13195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:10 dist-test-slave-bqcl krb5kdc[13195](info): set up 2 sockets
Aug 08 17:45:10 dist-test-slave-bqcl krb5kdc[13195](info): commencing operation
krb5kdc: starting...
W20260808 17:45:11.525434 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:11 dist-test-slave-bqcl krb5kdc[13195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:45:11.640867 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41237
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:36859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:41237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:11.722582 13215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:11.722792 13215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:11.722823 13215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:11.723935 13215 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:11.723978 13215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:11.723999 13215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:11.724013 13215 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:11.724030 13215 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:11.725548 13215 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:36859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:41237
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:41237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:11.725795 13215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:11.726004 13215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:11.730602 13228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:11.730638 13224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:11.730779 13215 server_base.cc:1034] running on GCE node
W20260808 17:45:11.730660 13223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:11.731104 13215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:11.731366 13215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:11.732503 13215 hybrid_clock.cc:648] HybridClock initialized: now 1786211111732491 us; error 29 us; skew 500 ppm
Aug 08 17:45:11 dist-test-slave-bqcl krb5kdc[13195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211111, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:11.735016 13215 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:45:11.735419 13215 webserver.cc:460] Webserver started at http://127.9.187.254:44827/ using document root <none> and password file <none>
I20260808 17:45:11.735613 13215 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:11.735658 13215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:11.735764 13215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:11.736783 13215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "09c823ad3dfd4e70845c381985e62739"
format_stamp: "Formatted at 2026-08-08 17:45:11 on dist-test-slave-bqcl"
server_key: "0f11ddade71c534cf2cde26c2c383b9b"
server_key_iv: "c0a2c6868b39e2330aac888133d10ea4"
server_key_version: "encryptionkey@0"
I20260808 17:45:11.737120 13215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "09c823ad3dfd4e70845c381985e62739"
format_stamp: "Formatted at 2026-08-08 17:45:11 on dist-test-slave-bqcl"
server_key: "0f11ddade71c534cf2cde26c2c383b9b"
server_key_iv: "c0a2c6868b39e2330aac888133d10ea4"
server_key_version: "encryptionkey@0"
I20260808 17:45:11.738372 13215 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:45:11.739159 13240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:11.739318 13215 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:45:11.739400 13215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "09c823ad3dfd4e70845c381985e62739"
format_stamp: "Formatted at 2026-08-08 17:45:11 on dist-test-slave-bqcl"
server_key: "0f11ddade71c534cf2cde26c2c383b9b"
server_key_iv: "c0a2c6868b39e2330aac888133d10ea4"
server_key_version: "encryptionkey@0"
I20260808 17:45:11.739462 13215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:11.742626 13215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:11.744443 13215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:11.744558 13215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:11.748313 13215 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:41237
I20260808 17:45:11.748345 13328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:41237 every 8 connection(s)
I20260808 17:45:11.748624 13215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:11.749550 13329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:11.751821 13329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739: Bootstrap starting.
I20260808 17:45:11.752380 13329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:11.752636 13329 log.cc:824] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:11.753263 13329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739: No bootstrap required, opened a new log
I20260808 17:45:11.754873 13329 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c823ad3dfd4e70845c381985e62739" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41237 } }
I20260808 17:45:11.755003 13329 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:11.755035 13329 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09c823ad3dfd4e70845c381985e62739, State: Initialized, Role: FOLLOWER
I20260808 17:45:11.755184 13329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c823ad3dfd4e70845c381985e62739" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41237 } }
I20260808 17:45:11.755251 13329 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:11.755285 13329 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:11.755331 13329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:11.755607 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 13215
I20260808 17:45:11.755709 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:11.755864 9967 external_mini_cluster.cc:1428] Setting key 253bf787cd367966d8e7c846061211b1
I20260808 17:45:11.756210 13329 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c823ad3dfd4e70845c381985e62739" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41237 } }
I20260808 17:45:11.756356 13329 leader_election.cc:302] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09c823ad3dfd4e70845c381985e62739; no voters:
I20260808 17:45:11.756568 13329 leader_election.cc:288] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:11.756609 13337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:11.756716 13337 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [term 1 LEADER]: Becoming Leader. State: Replica: 09c823ad3dfd4e70845c381985e62739, State: Running, Role: LEADER
I20260808 17:45:11.756830 13329 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:11.756863 13337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c823ad3dfd4e70845c381985e62739" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41237 } }
I20260808 17:45:11.757227 13340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09c823ad3dfd4e70845c381985e62739" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c823ad3dfd4e70845c381985e62739" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41237 } } }
I20260808 17:45:11.757299 13340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:11.757460 13341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09c823ad3dfd4e70845c381985e62739. Latest consensus state: current_term: 1 leader_uuid: "09c823ad3dfd4e70845c381985e62739" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c823ad3dfd4e70845c381985e62739" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 41237 } } }
I20260808 17:45:11.757562 13341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739 [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:11.757642 13349 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:11.758191 13349 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:11.758412 13334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:11.756287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41609 (local address 127.9.187.254:41237)
0808 17:45:11.756469 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:11.756477 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:11.756507 (+ 30us) server_negotiation.cc:407] Connection header received
0808 17:45:11.756618 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:11.756626 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:11.756657 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:11.757080 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:11.757751 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:11.757754 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:11.757755 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:11.757759 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:11.757796 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:11.757811 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:11.758094 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:11.758145 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 17:45:11.758186 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
I20260808 17:45:11.759469 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:11.759848 13349 catalog_manager.cc:1347] Generated new cluster ID: 2d61029f153a42ea8f7db3c943351f20
I20260808 17:45:11.759902 13349 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:11.767874 13334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:11.762432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49785 (local address 127.9.187.254:41237)
0808 17:45:11.762463 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:11.762465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:11.767012 (+ 4547us) server_negotiation.cc:407] Connection header received
0808 17:45:11.767085 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:11.767086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:11.767091 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:11.767138 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:11.767659 (+ 521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:11.767660 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:11.767660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:11.767665 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:11.767679 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:11.767684 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:11.767732 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:11.767787 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 17:45:11.767800 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:45:11.795238 13349 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:11.795418 13349 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:11.800769 13349 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09c823ad3dfd4e70845c381985e62739: Generated new TSK 0
I20260808 17:45:11.800947 13349 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:11.805856 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 13215
2026-08-08T17:45:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1424 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:11 dist-test-slave-bqcl krb5kdc[13382](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:11 dist-test-slave-bqcl krb5kdc[13382](info): set up 2 sockets
Aug 08 17:45:11 dist-test-slave-bqcl krb5kdc[13382](info): commencing operation
krb5kdc: starting...
W20260808 17:45:12.954483 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:13 dist-test-slave-bqcl krb5kdc[13382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:45:13.071254 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46363
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:42031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:46363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:13.152858 13402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:13.153065 13402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:13.153086 13402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:13.154192 13402 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:13.154233 13402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:13.154246 13402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:13.154258 13402 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:13.154268 13402 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:13.155678 13402 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:42031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:46363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:46363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:13.155902 13402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:13.156082 13402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:13.160766 13417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:13.160841 13402 server_base.cc:1034] running on GCE node
W20260808 17:45:13.160808 13415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:13.160794 13413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:13.161284 13402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:13.161561 13402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:13.162691 13402 hybrid_clock.cc:648] HybridClock initialized: now 1786211113162675 us; error 30 us; skew 500 ppm
Aug 08 17:45:13 dist-test-slave-bqcl krb5kdc[13382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211113, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:13.165195 13402 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:45:13.165669 13402 webserver.cc:460] Webserver started at http://127.9.187.254:34683/ using document root <none> and password file <none>
I20260808 17:45:13.165910 13402 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:13.165957 13402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:13.166064 13402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:13.167150 13402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "c9dac2c334884471acbb77464dcb2e9e"
format_stamp: "Formatted at 2026-08-08 17:45:13 on dist-test-slave-bqcl"
server_key: "95fe9472d7ea36bc3c8ef68c497547c3"
server_key_iv: "6af34cf1b14844f88c079ab446dd68d6"
server_key_version: "encryptionkey@0"
I20260808 17:45:13.167479 13402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "c9dac2c334884471acbb77464dcb2e9e"
format_stamp: "Formatted at 2026-08-08 17:45:13 on dist-test-slave-bqcl"
server_key: "95fe9472d7ea36bc3c8ef68c497547c3"
server_key_iv: "6af34cf1b14844f88c079ab446dd68d6"
server_key_version: "encryptionkey@0"
I20260808 17:45:13.168810 13402 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:45:13.169505 13431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:13.169679 13402 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:45:13.169778 13402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "c9dac2c334884471acbb77464dcb2e9e"
format_stamp: "Formatted at 2026-08-08 17:45:13 on dist-test-slave-bqcl"
server_key: "95fe9472d7ea36bc3c8ef68c497547c3"
server_key_iv: "6af34cf1b14844f88c079ab446dd68d6"
server_key_version: "encryptionkey@0"
I20260808 17:45:13.169859 13402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:13.194708 13402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:13.196913 13402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:13.197052 13402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:13.201119 13402 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:46363
I20260808 17:45:13.201171 13512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:46363 every 8 connection(s)
I20260808 17:45:13.201490 13402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:13.202406 13513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:13.204682 13513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e: Bootstrap starting.
I20260808 17:45:13.205260 13513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:13.205492 13513 log.cc:824] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:13.206163 13513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e: No bootstrap required, opened a new log
I20260808 17:45:13.206555 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 13402
I20260808 17:45:13.206674 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:13.206844 9967 external_mini_cluster.cc:1428] Setting key bfd4be58fdc01c9616a4dca6635f6de9
I20260808 17:45:13.208163 13513 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dac2c334884471acbb77464dcb2e9e" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46363 } }
I20260808 17:45:13.208335 13513 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:13.208374 13513 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9dac2c334884471acbb77464dcb2e9e, State: Initialized, Role: FOLLOWER
I20260808 17:45:13.208536 13513 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dac2c334884471acbb77464dcb2e9e" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46363 } }
I20260808 17:45:13.208603 13513 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:13.208624 13513 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:13.208657 13513 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:13.209601 13513 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dac2c334884471acbb77464dcb2e9e" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46363 } }
I20260808 17:45:13.209714 13513 leader_election.cc:302] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9dac2c334884471acbb77464dcb2e9e; no voters:
I20260808 17:45:13.209867 13513 leader_election.cc:288] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:13.209908 13521 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:13.210045 13521 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [term 1 LEADER]: Becoming Leader. State: Replica: c9dac2c334884471acbb77464dcb2e9e, State: Running, Role: LEADER
I20260808 17:45:13.210115 13513 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:13.210229 13521 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dac2c334884471acbb77464dcb2e9e" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46363 } }
I20260808 17:45:13.211417 13522 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9dac2c334884471acbb77464dcb2e9e. Latest consensus state: current_term: 1 leader_uuid: "c9dac2c334884471acbb77464dcb2e9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dac2c334884471acbb77464dcb2e9e" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46363 } } }
I20260808 17:45:13.211519 13522 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:13.211648 13523 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9dac2c334884471acbb77464dcb2e9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dac2c334884471acbb77464dcb2e9e" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 46363 } } }
W20260808 17:45:13.212045 13539 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 17:45:13.212561 13523 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e [sys.catalog]: This master's current role is: LEADER
W20260808 17:45:13.212570 13539 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:45:13.212744 13541 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:13.212953 13541 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 17:45:13 dist-test-slave-bqcl krb5kdc[13382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:45:13.218228 13519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:13.207374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38863 (local address 127.9.187.254:46363)
0808 17:45:13.207573 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:13.207584 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:13.207621 (+ 37us) server_negotiation.cc:407] Connection header received
0808 17:45:13.208127 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:13.208137 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:13.208201 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:13.208347 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:13.209083 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:13.210462 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:13.211521 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:13.212119 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:13.212232 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:13.214982 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:13.214985 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:13.214986 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:13.214996 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:13.216701 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:13.217105 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:13.217107 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:13.217108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:13.217218 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:13.217408 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:13.217409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:13.217409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:13.217652 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:13.217790 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:13.217891 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 17:45:13.217994 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":83,"threads_started":1}
I20260808 17:45:13.219200 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:13.219372 13541 catalog_manager.cc:1347] Generated new cluster ID: 033658263c9c4fd6bd2871ada13bf4a4
I20260808 17:45:13.219408 13541 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:13.224745 13541 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:13.225421 13541 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:13.227581 13519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:13.220621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50531 (local address 127.9.187.254:46363)
0808 17:45:13.220654 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:13.220656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:13.220784 (+ 128us) server_negotiation.cc:407] Connection header received
0808 17:45:13.220864 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:13.220865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:13.220874 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:13.220897 (+ 23us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:13.221511 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:13.222248 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:13.223264 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:13.223561 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:13.223624 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:13.224942 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:13.224943 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:13.224943 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:13.224950 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:13.226510 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:13.226874 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:13.226875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:13.226875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:13.226925 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:13.227110 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:13.227110 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:13.227111 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:13.227213 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:13.227313 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:13.227405 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 17:45:13.227487 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 17:45:13.231268 13541 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9dac2c334884471acbb77464dcb2e9e: Generated new TSK 0
I20260808 17:45:13.231438 13541 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:13.237653 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 13402
2026-08-08T17:45:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1436 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:13 dist-test-slave-bqcl krb5kdc[13553](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:13 dist-test-slave-bqcl krb5kdc[13553](info): set up 2 sockets
Aug 08 17:45:13 dist-test-slave-bqcl krb5kdc[13553](info): commencing operation
krb5kdc: starting...
W20260808 17:45:14.395957 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:14 dist-test-slave-bqcl krb5kdc[13553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:45:14.514834 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:39933
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:33771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:39933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:14.602771 13572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:14.602988 13572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:14.603011 13572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:14.604168 13572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:14.604218 13572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:14.604234 13572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:14.604246 13572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:14.604274 13572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:14.605790 13572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:33771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:39933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:39933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:14.606025 13572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:14.606271 13572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:14.611090 13577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:14.611059 13581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:14.611059 13585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:14.611377 13572 server_base.cc:1034] running on GCE node
I20260808 17:45:14.611644 13572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:14.611919 13572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:14.613067 13572 hybrid_clock.cc:648] HybridClock initialized: now 1786211114613051 us; error 31 us; skew 500 ppm
Aug 08 17:45:14 dist-test-slave-bqcl krb5kdc[13553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211114, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:14.618522 13572 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:45:14.618992 13572 webserver.cc:460] Webserver started at http://127.9.187.254:40285/ using document root <none> and password file <none>
I20260808 17:45:14.619232 13572 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:14.619282 13572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:14.619411 13572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:14.620465 13572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "b78d7e807e6246f5be85fdb7df7b0dda"
format_stamp: "Formatted at 2026-08-08 17:45:14 on dist-test-slave-bqcl"
server_key: "3ffd000c5552b033e2592212917deb9b"
server_key_iv: "5923008fca432a7c2e6cac01333e54fa"
server_key_version: "encryptionkey@0"
I20260808 17:45:14.620811 13572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "b78d7e807e6246f5be85fdb7df7b0dda"
format_stamp: "Formatted at 2026-08-08 17:45:14 on dist-test-slave-bqcl"
server_key: "3ffd000c5552b033e2592212917deb9b"
server_key_iv: "5923008fca432a7c2e6cac01333e54fa"
server_key_version: "encryptionkey@0"
I20260808 17:45:14.622008 13572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:45:14.622717 13594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:14.622864 13572 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:14.622951 13572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "b78d7e807e6246f5be85fdb7df7b0dda"
format_stamp: "Formatted at 2026-08-08 17:45:14 on dist-test-slave-bqcl"
server_key: "3ffd000c5552b033e2592212917deb9b"
server_key_iv: "5923008fca432a7c2e6cac01333e54fa"
server_key_version: "encryptionkey@0"
I20260808 17:45:14.623009 13572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:14.629999 13572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:14.632056 13572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:14.632184 13572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:14.636062 13572 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:39933
I20260808 17:45:14.636092 13679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:39933 every 8 connection(s)
I20260808 17:45:14.636397 13572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:14.637214 13680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:14.639426 13680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda: Bootstrap starting.
I20260808 17:45:14.639964 13680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:14.640193 13680 log.cc:824] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:14.640846 13680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda: No bootstrap required, opened a new log
I20260808 17:45:14.641007 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 13572
I20260808 17:45:14.641124 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:14.641275 9967 external_mini_cluster.cc:1428] Setting key 15d72a267f789a19c8730838bb57c1b1
I20260808 17:45:14.643035 13680 raft_consensus.cc:348] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d7e807e6246f5be85fdb7df7b0dda" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39933 } }
I20260808 17:45:14.643211 13680 raft_consensus.cc:374] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:14.643249 13680 raft_consensus.cc:729] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b78d7e807e6246f5be85fdb7df7b0dda, State: Initialized, Role: FOLLOWER
I20260808 17:45:14.643405 13680 consensus_queue.cc:260] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d7e807e6246f5be85fdb7df7b0dda" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39933 } }
I20260808 17:45:14.643483 13680 raft_consensus.cc:388] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:14.643517 13680 raft_consensus.cc:482] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:14.643563 13680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:14.644093 13680 raft_consensus.cc:504] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d7e807e6246f5be85fdb7df7b0dda" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39933 } }
I20260808 17:45:14.644181 13680 leader_election.cc:302] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b78d7e807e6246f5be85fdb7df7b0dda; no voters:
I20260808 17:45:14.644330 13680 leader_election.cc:288] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:14.644366 13690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:14.644517 13690 raft_consensus.cc:686] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [term 1 LEADER]: Becoming Leader. State: Replica: b78d7e807e6246f5be85fdb7df7b0dda, State: Running, Role: LEADER
I20260808 17:45:14.644608 13680 sys_catalog.cc:564] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:14.644654 13690 consensus_queue.cc:237] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d7e807e6246f5be85fdb7df7b0dda" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39933 } }
I20260808 17:45:14.645020 13690 sys_catalog.cc:455] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [sys.catalog]: SysCatalogTable state changed. Reason: New leader b78d7e807e6246f5be85fdb7df7b0dda. Latest consensus state: current_term: 1 leader_uuid: "b78d7e807e6246f5be85fdb7df7b0dda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d7e807e6246f5be85fdb7df7b0dda" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39933 } } }
I20260808 17:45:14.645272 13690 sys_catalog.cc:458] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:14.645692 13699 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:14.645190 13692 sys_catalog.cc:455] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b78d7e807e6246f5be85fdb7df7b0dda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d7e807e6246f5be85fdb7df7b0dda" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 39933 } } }
I20260808 17:45:14.646003 13692 sys_catalog.cc:458] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:14.646224 13699 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:14.647861 13699 catalog_manager.cc:1347] Generated new cluster ID: 57ff9a7cc90947aca4e94ca8dad269cd
I20260808 17:45:14.647912 13699 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:14.648187 13689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:14.641751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40067 (local address 127.9.187.254:39933)
0808 17:45:14.641949 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:14.641959 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:14.641993 (+ 34us) server_negotiation.cc:407] Connection header received
0808 17:45:14.643014 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:14.643024 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:14.643089 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:14.643233 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:14.643476 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:14.645006 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:14.646171 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:14.646705 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:14.646802 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:14.647494 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:14.647497 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:14.647498 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:14.647696 (+ 198us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:14.647735 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:14.647750 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:14.647815 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:14.647905 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 17:45:14.647969 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
I20260808 17:45:14.649176 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:14.654302 13689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:14.650759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40407 (local address 127.9.187.254:39933)
0808 17:45:14.650796 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:14.650798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:14.650916 (+ 118us) server_negotiation.cc:407] Connection header received
0808 17:45:14.651016 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:14.651017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:14.651027 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:14.651055 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:14.651234 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:14.651920 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:14.652943 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:14.653251 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:14.653292 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:14.654003 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:14.654004 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:14.654005 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:14.654018 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:14.654032 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:14.654036 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:14.654062 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:14.654205 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 17:45:14.654229 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:45:14.678808 13699 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:14.679348 13699 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:14.685556 13699 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b78d7e807e6246f5be85fdb7df7b0dda: Generated new TSK 0
I20260808 17:45:14.685732 13699 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:14.688711 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 13572
2026-08-08T17:45:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:14 dist-test-slave-bqcl krb5kdc[13726](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:14 dist-test-slave-bqcl krb5kdc[13726](info): set up 2 sockets
Aug 08 17:45:14 dist-test-slave-bqcl krb5kdc[13726](info): commencing operation
krb5kdc: starting...
W20260808 17:45:15.851692 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:15 dist-test-slave-bqcl krb5kdc[13726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:45:15.970984 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:44053
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:34243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:44053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:16.053934 13745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:16.054167 13745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:16.054191 13745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:16.055349 13745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:16.055392 13745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:16.055405 13745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:16.055416 13745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:16.055428 13745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:16.056854 13745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:34243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:44053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:44053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:16.057049 13745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:16.057236 13745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:16.061977 13754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:16.061980 13757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:16.062237 13745 server_base.cc:1034] running on GCE node
W20260808 17:45:16.062001 13755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:16.062594 13745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:16.062887 13745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:16.064033 13745 hybrid_clock.cc:648] HybridClock initialized: now 1786211116064018 us; error 28 us; skew 500 ppm
Aug 08 17:45:16 dist-test-slave-bqcl krb5kdc[13726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211116, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:16.066550 13745 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:45:16.066946 13745 webserver.cc:460] Webserver started at http://127.9.187.254:42809/ using document root <none> and password file <none>
I20260808 17:45:16.067143 13745 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:16.067183 13745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:16.067277 13745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:16.068284 13745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "976ac17a425440f39a572fe93ccbe12d"
format_stamp: "Formatted at 2026-08-08 17:45:16 on dist-test-slave-bqcl"
server_key: "5926a104d2e30f9662d14c466f5e35e1"
server_key_iv: "bcd4ce61a692bb282ab2d4e406bc5dc5"
server_key_version: "encryptionkey@0"
I20260808 17:45:16.068584 13745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "976ac17a425440f39a572fe93ccbe12d"
format_stamp: "Formatted at 2026-08-08 17:45:16 on dist-test-slave-bqcl"
server_key: "5926a104d2e30f9662d14c466f5e35e1"
server_key_iv: "bcd4ce61a692bb282ab2d4e406bc5dc5"
server_key_version: "encryptionkey@0"
I20260808 17:45:16.069818 13745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 17:45:16.070541 13767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:16.070703 13745 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:16.070781 13745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "976ac17a425440f39a572fe93ccbe12d"
format_stamp: "Formatted at 2026-08-08 17:45:16 on dist-test-slave-bqcl"
server_key: "5926a104d2e30f9662d14c466f5e35e1"
server_key_iv: "bcd4ce61a692bb282ab2d4e406bc5dc5"
server_key_version: "encryptionkey@0"
I20260808 17:45:16.070837 13745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:16.073987 13745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:16.076066 13745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:16.076169 13745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:16.079973 13745 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:44053
I20260808 17:45:16.080013 13857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:44053 every 8 connection(s)
I20260808 17:45:16.080299 13745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:16.081266 13861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:16.083504 13861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d: Bootstrap starting.
I20260808 17:45:16.084065 13861 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:16.084323 13861 log.cc:824] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:16.084964 13861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d: No bootstrap required, opened a new log
I20260808 17:45:16.085210 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 13745
I20260808 17:45:16.085315 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:16.085496 9967 external_mini_cluster.cc:1428] Setting key 730c8b2ef8c925bc48fb666c45741fcb
I20260808 17:45:16.087049 13861 raft_consensus.cc:348] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976ac17a425440f39a572fe93ccbe12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44053 } }
I20260808 17:45:16.087220 13861 raft_consensus.cc:374] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:45:16.087260 13861 raft_consensus.cc:729] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 976ac17a425440f39a572fe93ccbe12d, State: Initialized, Role: FOLLOWER
I20260808 17:45:16.087432 13861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976ac17a425440f39a572fe93ccbe12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44053 } }
I20260808 17:45:16.087536 13861 raft_consensus.cc:388] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:45:16.087569 13861 raft_consensus.cc:482] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:45:16.087626 13861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:16.088243 13867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:16.085961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46119 (local address 127.9.187.254:44053)
0808 17:45:16.086186 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:16.086196 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:16.086230 (+ 34us) server_negotiation.cc:407] Connection header received
0808 17:45:16.087010 (+ 780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:16.087020 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:16.087057 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:16.087214 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:16.087795 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:16.087799 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:16.087799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:16.087804 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:16.087849 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:16.087864 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:16.087939 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:16.087977 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 17:45:16.088021 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":81,"threads_started":1}
I20260808 17:45:16.088581 13861 raft_consensus.cc:504] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976ac17a425440f39a572fe93ccbe12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44053 } }
I20260808 17:45:16.088696 13861 leader_election.cc:302] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 976ac17a425440f39a572fe93ccbe12d; no voters:
I20260808 17:45:16.088842 13861 leader_election.cc:288] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:45:16.088893 13868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:16.089046 13868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [term 1 LEADER]: Becoming Leader. State: Replica: 976ac17a425440f39a572fe93ccbe12d, State: Running, Role: LEADER
I20260808 17:45:16.089080 13861 sys_catalog.cc:564] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:16.089133 13868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976ac17a425440f39a572fe93ccbe12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44053 } }
I20260808 17:45:16.089167 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:16.089419 13868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "976ac17a425440f39a572fe93ccbe12d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976ac17a425440f39a572fe93ccbe12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44053 } } }
I20260808 17:45:16.089476 13868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:16.089596 13868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 976ac17a425440f39a572fe93ccbe12d. Latest consensus state: current_term: 1 leader_uuid: "976ac17a425440f39a572fe93ccbe12d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976ac17a425440f39a572fe93ccbe12d" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 44053 } } }
I20260808 17:45:16.089638 13868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:16.090265 13876 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:16.090783 13876 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:16.092216 13867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:16.090823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47013 (local address 127.9.187.254:44053)
0808 17:45:16.090856 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:16.090858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:16.091317 (+ 459us) server_negotiation.cc:407] Connection header received
0808 17:45:16.091402 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:16.091403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:16.091408 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:16.091456 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:16.091978 (+ 522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:16.091979 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:16.091979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:45:16.091983 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:16.091999 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:45:16.092003 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:16.092069 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:16.092146 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 17:45:16.092159 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:45:16.092551 13876 catalog_manager.cc:1347] Generated new cluster ID: 3ba8487a053d40239fcb24b97de17181
I20260808 17:45:16.092603 13876 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:16.108016 13876 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:16.108193 13876 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:16.111099 13876 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 976ac17a425440f39a572fe93ccbe12d: Generated new TSK 0
I20260808 17:45:16.111263 13876 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:45:16.114101 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 13745
2026-08-08T17:45:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1419 ms)
[----------] 18 tests from AuthTokenIssuingTest (25856 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:16 dist-test-slave-bqcl krb5kdc[13910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:16 dist-test-slave-bqcl krb5kdc[13910](info): set up 2 sockets
Aug 08 17:45:16 dist-test-slave-bqcl krb5kdc[13910](info): commencing operation
krb5kdc: starting...
W20260808 17:45:17.262945 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:45:17.381251 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:34341
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:35369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:34341,127.9.187.253:42271,127.9.187.252:41687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:17.462069 13943 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:45:17.462318 13943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:17.462334 13943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:17.462352 13943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:17.463426 13943 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:17.463457 13943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:17.463469 13943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:17.463480 13943 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:17.463490 13943 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:17.464882 13943 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:34341,127.9.187.253:42271,127.9.187.252:41687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:34341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:17.465065 13943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:17.465260 13943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:17.469906 13955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:17.469942 13950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:17.469935 13951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:17.470211 13943 server_base.cc:1034] running on GCE node
I20260808 17:45:17.470515 13943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:17.470798 13943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:17.471944 13943 hybrid_clock.cc:648] HybridClock initialized: now 1786211117471924 us; error 36 us; skew 500 ppm
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:17.474365 13943 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:45:17.474779 13943 webserver.cc:460] Webserver started at http://127.9.187.254:38493/ using document root <none> and password file <none>
I20260808 17:45:17.475000 13943 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:17.475059 13943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:17.475186 13943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:17.476248 13943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "d1f93f9eb59242369f52f8c5b67d8a24"
format_stamp: "Formatted at 2026-08-08 17:45:17 on dist-test-slave-bqcl"
server_key: "f6876df12bbbe1bb13eb222a8efa3026"
server_key_iv: "247c331daa28ce00b0fcf08e12c0c97d"
server_key_version: "encryptionkey@0"
I20260808 17:45:17.476581 13943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "d1f93f9eb59242369f52f8c5b67d8a24"
format_stamp: "Formatted at 2026-08-08 17:45:17 on dist-test-slave-bqcl"
server_key: "f6876df12bbbe1bb13eb222a8efa3026"
server_key_iv: "247c331daa28ce00b0fcf08e12c0c97d"
server_key_version: "encryptionkey@0"
I20260808 17:45:17.477788 13943 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:45:17.478462 13973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:17.478611 13943 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:17.478698 13943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "d1f93f9eb59242369f52f8c5b67d8a24"
format_stamp: "Formatted at 2026-08-08 17:45:17 on dist-test-slave-bqcl"
server_key: "f6876df12bbbe1bb13eb222a8efa3026"
server_key_iv: "247c331daa28ce00b0fcf08e12c0c97d"
server_key_version: "encryptionkey@0"
I20260808 17:45:17.478755 13943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:17.495106 13943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:17.496860 13943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:17.496996 13943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:17.500756 13943 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:34341
I20260808 17:45:17.500797 14061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:34341 every 8 connection(s)
I20260808 17:45:17.501111 13943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:17.502022 14062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:17.503554 14062 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:17.506647 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 13943
I20260808 17:45:17.506747 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:17.506929 9967 external_mini_cluster.cc:1428] Setting key dcad47db0191cb9139c10800a4d01a0c
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:45:17.512835 14066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.504354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55962 (local address 127.9.187.254:34341)
0808 17:45:17.504459 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.504463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.504496 (+ 33us) server_negotiation.cc:407] Connection header received
0808 17:45:17.505011 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.505013 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.505029 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.505103 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.505628 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.506463 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.507380 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.507680 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.507774 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.509870 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.509877 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.509877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.509883 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.511315 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.511738 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.511740 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.511740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.511820 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.512068 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.512068 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.512068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.512260 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.512317 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.512532 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.512653 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":15,"server-negotiator.queue_time_us":82,"thread_start_us":40,"threads_started":1}
I20260808 17:45:17.512845 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.504192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:34341 (local address 127.0.0.1:55962)
0808 17:45:17.504360 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.504396 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:17.504867 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:17.505121 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:17.505124 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:17.505394 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:17.505538 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.505543 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.506540 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.506541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.507297 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.507300 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.507765 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.507767 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.507830 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.508266 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:17.508274 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:17.509793 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:17.511387 (+ 1594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.511395 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.511397 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.511652 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.511886 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.511887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.511887 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.512001 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.512319 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:17.512326 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:17.512405 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 17:45:17.512511 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 17:45:17.512730 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":67,"thread_start_us":68,"threads_started":1}
I20260808 17:45:17.513572 14062 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:17.513916 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.513801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:42271 (local address 127.0.0.1:39212)
0808 17:45:17.513846 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.513892 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:42271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 17:45:17.514053 13977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.187.253:42271: connect: Connection refused (error 111)
I20260808 17:45:17.514467 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.514370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:42271 (local address 127.0.0.1:39222)
0808 17:45:17.514417 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.514445 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:42271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 17:45:17.514569 14062 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.253:42271: Network error: Client connection negotiation failed: client connection to 127.9.187.253:42271: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.9.187.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab.
Entry for principal kudu/127.9.187.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab.
I20260808 17:45:17.530572 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.253:42271
--webserver_interface=127.9.187.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab
--principal=kudu/127.9.187.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:35369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:34341,127.9.187.253:42271,127.9.187.252:41687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:45:17.563800 14062 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } attempt: 1
I20260808 17:45:17.564327 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.564180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:42271 (local address 127.0.0.1:39234)
0808 17:45:17.564241 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.564288 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:42271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 17:45:17.564641 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.564551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:42271 (local address 127.0.0.1:39236)
0808 17:45:17.564592 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.564619 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:42271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:45:17.564738 14062 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.253:42271: Network error: Client connection negotiation failed: client connection to 127.9.187.253:42271: connect: Connection refused (error 111)
W20260808 17:45:17.610723 14072 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:45:17.610919 14072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:17.610935 14072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:17.610953 14072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:17.612056 14072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:17.612097 14072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:17.612109 14072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:17.612120 14072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:17.612130 14072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:17.613529 14072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:34341,127.9.187.253:42271,127.9.187.252:41687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab
--principal=kudu/127.9.187.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.253:42271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.187.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:17.613744 14072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:17.613945 14072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:17.618335 14079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:17.618451 14072 server_base.cc:1034] running on GCE node
W20260808 17:45:17.618381 14082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:17.618356 14080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:17.618795 14072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:17.619065 14072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:17.620208 14072 hybrid_clock.cc:648] HybridClock initialized: now 1786211117620188 us; error 31 us; skew 500 ppm
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:17.622622 14072 init.cc:377] Logged in from keytab as kudu/127.9.187.253@KRBTEST.COM (short username kudu)
I20260808 17:45:17.623020 14072 webserver.cc:460] Webserver started at http://127.9.187.253:37735/ using document root <none> and password file <none>
I20260808 17:45:17.623219 14072 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:17.623268 14072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:17.623390 14072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:17.624351 14072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/data/instance:
uuid: "a95c6cc5a0364cb19fc0bb060d058b63"
format_stamp: "Formatted at 2026-08-08 17:45:17 on dist-test-slave-bqcl"
server_key: "e6756102fdfbbad43493da7ba27d0eec"
server_key_iv: "693cd2ee3aa3bf1da97a6dd7ff25d08e"
server_key_version: "encryptionkey@0"
I20260808 17:45:17.624679 14072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/wal/instance:
uuid: "a95c6cc5a0364cb19fc0bb060d058b63"
format_stamp: "Formatted at 2026-08-08 17:45:17 on dist-test-slave-bqcl"
server_key: "e6756102fdfbbad43493da7ba27d0eec"
server_key_iv: "693cd2ee3aa3bf1da97a6dd7ff25d08e"
server_key_version: "encryptionkey@0"
I20260808 17:45:17.625844 14072 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:45:17.626510 14091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:17.626678 14072 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:17.626760 14072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/wal
uuid: "a95c6cc5a0364cb19fc0bb060d058b63"
format_stamp: "Formatted at 2026-08-08 17:45:17 on dist-test-slave-bqcl"
server_key: "e6756102fdfbbad43493da7ba27d0eec"
server_key_iv: "693cd2ee3aa3bf1da97a6dd7ff25d08e"
server_key_version: "encryptionkey@0"
I20260808 17:45:17.626824 14072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:17.632887 14062 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } attempt: 2
I20260808 17:45:17.633257 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.633150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:42271 (local address 127.0.0.1:39242)
0808 17:45:17.633199 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.633228 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:42271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 17:45:17.633566 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.633488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:42271 (local address 127.0.0.1:39258)
0808 17:45:17.633526 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.633550 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:42271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 17:45:17.633642 14062 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.253:42271: Network error: Client connection negotiation failed: client connection to 127.9.187.253:42271: connect: Connection refused (error 111)
I20260808 17:45:17.644826 14072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:17.646857 14072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:17.646960 14072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:17.650699 14072 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.253:42271
I20260808 17:45:17.650749 14177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.253:42271 every 8 connection(s)
I20260808 17:45:17.651052 14072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
I20260808 17:45:17.652009 14182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:17.653501 14182 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:17.655274 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 14072
I20260808 17:45:17.655361 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-1/wal/instance
I20260808 17:45:17.655544 9967 external_mini_cluster.cc:1428] Setting key cc5f4b28d7d190fe1eb9f051885724c6
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:45:17.661859 14066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.654161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55978 (local address 127.9.187.254:34341)
0808 17:45:17.654218 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.654219 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.654384 (+ 165us) server_negotiation.cc:407] Connection header received
0808 17:45:17.654816 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.654817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.654826 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.654876 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.655484 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.656113 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.657080 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.657293 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.657351 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.659371 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.659373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.659373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.659380 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.660612 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.660974 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.660976 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.660976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.661029 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.661251 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.661252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.661252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.661362 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.661418 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.661682 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.661768 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:45:17.662009 14184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.654093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:34341 (local address 127.0.0.1:55978)
0808 17:45:17.654271 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.654311 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:17.654743 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:17.654929 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:17.654932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:17.655185 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:17.655397 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.655404 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.656208 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.656209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.656989 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.656991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.657380 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.657381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.657503 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.657939 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:17.657947 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:17.659281 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:17.660687 (+ 1406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.660694 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.660696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.660908 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.661090 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.661091 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.661091 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.661195 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.661418 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:17.661425 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:17.661563 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 17:45:17.661651 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 17:45:17.661798 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":95,"threads_started":1}
I20260808 17:45:17.662580 14182 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.9.187.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.252@KRBTEST.COM" created.
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
I20260808 17:45:17.669581 14184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.662806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:42271 (local address 127.0.0.1:39272)
0808 17:45:17.662845 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.662855 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:17.662894 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:17.663129 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:17.663130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:17.663255 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:17.663300 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.663301 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.664153 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.664154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.664649 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.664651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.665074 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.665075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.665143 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.665442 (+ 299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:17.665446 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:17.666767 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:17.668519 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.668520 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.668520 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.668696 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.668929 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.668930 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.668931 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.668995 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.669323 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:17.669324 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:17.669363 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 17:45:17.669420 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 17:45:17.669508 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 17:45:17.669693 14187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.662879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39272 (local address 127.9.187.253:42271)
0808 17:45:17.663007 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.663011 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.663028 (+ 17us) server_negotiation.cc:407] Connection header received
0808 17:45:17.663046 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.663048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.663060 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.663118 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.663368 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.664070 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.664713 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.665007 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.665093 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.666850 (+ 1757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.666858 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.666858 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.666864 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.668423 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.668771 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.668774 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.668775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.668840 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.669070 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.669071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.669071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.669244 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.669324 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.669465 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.669571 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":103,"thread_start_us":81,"threads_started":1}
I20260808 17:45:17.670320 14182 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:17.670660 14184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.670531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49780)
0808 17:45:17.670576 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.670628 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 17:45:17.670797 14098 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
I20260808 17:45:17.671226 14184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.671128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49794)
0808 17:45:17.671171 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.671202 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 17:45:17.671329 14182 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:41687: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab.
Entry for principal kudu/127.9.187.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab.
I20260808 17:45:17.680874 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.252:41687
--webserver_interface=127.9.187.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab
--principal=kudu/127.9.187.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:35369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:34341,127.9.187.253:42271,127.9.187.252:41687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:45:17.720559 14182 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } attempt: 1
I20260808 17:45:17.721076 14184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.720933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49798)
0808 17:45:17.720993 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.721039 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 17:45:17.721395 14184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.721309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49806)
0808 17:45:17.721347 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.721373 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 17:45:17.721498 14182 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:41687: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
I20260808 17:45:17.724783 14062 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } attempt: 3
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
I20260808 17:45:17.731761 14187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.725100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39288 (local address 127.9.187.253:42271)
0808 17:45:17.725151 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.725153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.725167 (+ 14us) server_negotiation.cc:407] Connection header received
0808 17:45:17.725250 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.725251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.725265 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.725315 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.725667 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.726188 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.727153 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.727366 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.727412 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.729390 (+ 1978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.729392 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.729392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.729399 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.730753 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.731067 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.731068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.731069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.731122 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.731285 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.731286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.731287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.731393 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.731448 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.731596 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.731668 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:45:17.731765 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.725044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:42271 (local address 127.0.0.1:39288)
0808 17:45:17.725111 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.725122 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:17.725183 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:17.725331 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:17.725332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:17.725514 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:17.725590 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.725592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.726250 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.726251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.727080 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.727084 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.727424 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.727426 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.727506 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.727915 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:17.727920 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:17.729309 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:17.730830 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.730831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.730832 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.731002 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.731176 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.731177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.731177 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.731235 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.731448 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:17.731449 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:17.731508 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 17:45:17.731567 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:45:17.731669 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 17:45:17.732154 14062 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:17.732442 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.732348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49812)
0808 17:45:17.732388 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.732416 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 17:45:17.732712 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.732633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49822)
0808 17:45:17.732668 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.732690 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 17:45:17.732793 14062 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:41687: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
W20260808 17:45:17.762022 14192 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:45:17.762270 14192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:17.762300 14192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:17.762334 14192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:17.763423 14192 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:17.763463 14192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:17.763480 14192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:17.763495 14192 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:17.763511 14192 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:17.763957 14062 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } attempt: 1
I20260808 17:45:17.764376 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.764233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49824)
0808 17:45:17.764295 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.764340 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 17:45:17.764708 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.764612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49826)
0808 17:45:17.764658 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.764685 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 17:45:17.764799 14062 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:41687: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
I20260808 17:45:17.765275 14192 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:34341,127.9.187.253:42271,127.9.187.252:41687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab
--principal=kudu/127.9.187.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.252:41687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.187.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:17.765496 14192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:17.765707 14192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:17.770154 14198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:17.770185 14203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:17.770210 14200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:17.770335 14192 server_base.cc:1034] running on GCE node
I20260808 17:45:17.770570 14192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:17.770831 14192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:17.771976 14192 hybrid_clock.cc:648] HybridClock initialized: now 1786211117771966 us; error 26 us; skew 500 ppm
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:17.774336 14192 init.cc:377] Logged in from keytab as kudu/127.9.187.252@KRBTEST.COM (short username kudu)
I20260808 17:45:17.774753 14192 webserver.cc:460] Webserver started at http://127.9.187.252:37459/ using document root <none> and password file <none>
I20260808 17:45:17.774957 14192 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:17.775005 14192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:17.775142 14192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:17.776093 14192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/data/instance:
uuid: "553c8f082ca240b9967ef94394a1768a"
format_stamp: "Formatted at 2026-08-08 17:45:17 on dist-test-slave-bqcl"
server_key: "552673529d00966187556b13a6d1cfd9"
server_key_iv: "f2fc2d00eac5a6e2fb727746d59a706c"
server_key_version: "encryptionkey@0"
I20260808 17:45:17.776386 14192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/wal/instance:
uuid: "553c8f082ca240b9967ef94394a1768a"
format_stamp: "Formatted at 2026-08-08 17:45:17 on dist-test-slave-bqcl"
server_key: "552673529d00966187556b13a6d1cfd9"
server_key_iv: "f2fc2d00eac5a6e2fb727746d59a706c"
server_key_version: "encryptionkey@0"
I20260808 17:45:17.777752 14192 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:45:17.778410 14218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:17.778566 14192 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:45:17.778678 14192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/wal
uuid: "553c8f082ca240b9967ef94394a1768a"
format_stamp: "Formatted at 2026-08-08 17:45:17 on dist-test-slave-bqcl"
server_key: "552673529d00966187556b13a6d1cfd9"
server_key_iv: "f2fc2d00eac5a6e2fb727746d59a706c"
server_key_version: "encryptionkey@0"
I20260808 17:45:17.778740 14192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:17.789666 14182 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } attempt: 2
I20260808 17:45:17.790046 14184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.789920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49842)
0808 17:45:17.789971 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.790011 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:45:17.790375 14184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.790296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49856)
0808 17:45:17.790333 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.790357 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 17:45:17.790460 14182 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:41687: Network error: Client connection negotiation failed: client connection to 127.9.187.252:41687: connect: Connection refused (error 111)
I20260808 17:45:17.795106 14192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:17.797082 14192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:17.797206 14192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:17.800845 14192 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.252:41687
I20260808 17:45:17.800884 14291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.252:41687 every 8 connection(s)
I20260808 17:45:17.801182 14192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
I20260808 17:45:17.802078 14292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:17.803534 14292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:17.805527 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 14192
I20260808 17:45:17.805631 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786210848752357-9967-0/minicluster-data/master-2/wal/instance
I20260808 17:45:17.805799 9967 external_mini_cluster.cc:1428] Setting key 7f0c5978b72abc4bad7f41398cfbe5f3
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
I20260808 17:45:17.811830 14066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.804118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55984 (local address 127.9.187.254:34341)
0808 17:45:17.804173 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.804174 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.804357 (+ 183us) server_negotiation.cc:407] Connection header received
0808 17:45:17.804823 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.804823 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.804832 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.804869 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.805432 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.805960 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.807104 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.807296 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.807344 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.809420 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.809422 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.809422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.809429 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.810622 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.810971 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.810973 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.810973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.811026 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.811245 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.811246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.811246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.811352 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.811406 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.811661 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.811743 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:45:17.812062 14294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.804106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:34341 (local address 127.0.0.1:55984)
0808 17:45:17.804254 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.804293 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:17.804736 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:17.804925 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:17.804928 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:17.805148 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:17.805348 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.805353 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.806048 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.806049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.807000 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.807001 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.807383 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.807385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.807512 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.807910 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:17.807919 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:17.809342 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:17.810693 (+ 1351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.810699 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.810701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.810905 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.811087 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.811087 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.811088 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.811189 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.811409 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:17.811415 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:17.811541 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 17:45:17.811629 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 17:45:17.811851 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
I20260808 17:45:17.812597 14292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:17.814055 14297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.806149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49866 (local address 127.9.187.252:41687)
0808 17:45:17.806311 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.806315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.806331 (+ 16us) server_negotiation.cc:407] Connection header received
0808 17:45:17.806376 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.806379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.806397 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.806471 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.806996 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.807900 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.808611 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.808902 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.808959 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.811325 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.811333 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.811333 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.811341 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.813088 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.813407 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.813409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.813409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.813455 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.813628 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.813628 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.813628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.813731 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.813825 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.813907 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.813965 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":85,"threads_started":1}
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:45:17.819155 14294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.812828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:42271 (local address 127.0.0.1:39290)
0808 17:45:17.812924 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.812933 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:17.812965 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:17.813084 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:17.813085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:17.813187 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:17.813213 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.813214 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.813992 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.813993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.814710 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.814712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.815166 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.815167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.815226 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.815512 (+ 286us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:17.815517 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:17.816726 (+ 1209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:17.818290 (+ 1564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.818292 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.818292 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.818464 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.818664 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.818665 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.818665 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.818709 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.818936 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:17.818937 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:17.818979 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 17:45:17.819038 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:45:17.819100 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 17:45:17.819235 14187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.812883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39290 (local address 127.9.187.253:42271)
0808 17:45:17.812950 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.812952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.812963 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:45:17.813008 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.813009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.813019 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.813081 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.813279 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.813916 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.814780 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.815059 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.815114 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.816801 (+ 1687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.816802 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.816802 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.816808 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.818218 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.818527 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.818527 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.818528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.818586 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.818758 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.818759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.818759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.818882 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.818943 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.819073 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.819147 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 17:45:17.819506 14292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:17.821602 14066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.814901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55988 (local address 127.9.187.254:34341)
0808 17:45:17.814933 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.814935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.814965 (+ 30us) server_negotiation.cc:407] Connection header received
0808 17:45:17.815023 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.815024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.815033 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.815080 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.815605 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.816018 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.816897 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.817160 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.817224 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.819339 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.819341 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.819341 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.819349 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.820665 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.820954 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.820955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.820955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.821005 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.821166 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.821166 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.821167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.821268 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.821422 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.821458 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.821523 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
I20260808 17:45:17.825435 14294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.819707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49872)
0808 17:45:17.819740 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.819751 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:17.819787 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:17.819887 (+ 100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:17.819887 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:17.820002 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:17.820031 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.820032 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.820581 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.820582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.821020 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.821021 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.821333 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.821334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.821378 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.821874 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:17.821878 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:17.823024 (+ 1146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:17.824449 (+ 1425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.824450 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.824450 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.824649 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.824835 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.824836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.824836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.824896 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.825100 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:17.825101 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:17.825145 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 17:45:17.825218 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 17:45:17.825319 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 17:45:17.825444 14297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.819735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49872 (local address 127.9.187.252:41687)
0808 17:45:17.819762 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.819763 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.819773 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:45:17.819838 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.819838 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.819846 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.819885 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.820088 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.820515 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.821087 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.821281 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.821330 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.823096 (+ 1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.823097 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.823097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.823102 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.824359 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.824716 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.824717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.824718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.824777 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.824953 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.824954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.824954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.825044 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.825091 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.825233 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.825361 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":15}
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
I20260808 17:45:17.827026 14292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a: Bootstrap starting.
I20260808 17:45:17.827876 14292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:17.828150 14292 log.cc:824] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:17.828935 14292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a: No bootstrap required, opened a new log
I20260808 17:45:17.829146 14187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.822277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39292 (local address 127.9.187.253:42271)
0808 17:45:17.822313 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.822314 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.822323 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:45:17.822367 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.822367 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.822376 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.822438 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.822824 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.823389 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.824086 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.824385 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.824443 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.826824 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.826825 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.826825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.826831 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.828047 (+ 1216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.828395 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.828396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.828397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.828456 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.828642 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.828643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.828644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.828740 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.828853 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.828934 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.828991 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:45:17.830412 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:17.830787 14292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } }
I20260808 17:45:17.830901 14292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553c8f082ca240b9967ef94394a1768a, State: Initialized, Role: FOLLOWER
I20260808 17:45:17.830974 14292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } }
I20260808 17:45:17.831281 14292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:17.831692 14022 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d1f93f9eb59242369f52f8c5b67d8a24"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55988
I20260808 17:45:17.832734 14301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } } }
I20260808 17:45:17.832950 14301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [sys.catalog]: This master's current role is: FOLLOWER
W20260808 17:45:17.833021 14323 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:45:17.833077 14323 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:45:17.833359 14192 master_runner.cc:186] Error getting master registration for 127.9.187.254:34341: OK, instance_id { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" instance_seqno: 1786211117499737 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:45:17.836092 14192 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:45:17.839936 14062 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } attempt: 2
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
I20260808 17:45:17.847404 14297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.840240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49880 (local address 127.9.187.252:41687)
0808 17:45:17.840279 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.840280 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.840290 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:45:17.840309 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.840310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.840319 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.840388 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.840756 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.841433 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.842429 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.842735 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.842803 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.844806 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.844807 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.844807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.844814 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.846332 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.846691 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.846692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.846692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.846743 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.846907 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.846908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.846908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.847060 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.847120 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.847246 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.847316 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:45:17.847410 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.840160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49880)
0808 17:45:17.840205 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.840215 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:17.840253 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:17.840389 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:17.840390 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:17.840508 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:17.840664 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.840668 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.841509 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.841510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.842352 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.842354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.842800 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.842801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.842851 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.843274 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:17.843278 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:17.844709 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:17.846401 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.846402 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.846403 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.846617 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.846795 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.846796 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.846796 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.846856 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.847116 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:17.847117 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:17.847161 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 17:45:17.847226 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 17:45:17.847315 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 17:45:17.848913 14062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24: Bootstrap starting.
I20260808 17:45:17.849504 14062 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:17.849771 14062 log.cc:824] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:17.850442 14062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24: No bootstrap required, opened a new log
I20260808 17:45:17.851374 14062 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } }
I20260808 17:45:17.851480 14062 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1f93f9eb59242369f52f8c5b67d8a24, State: Initialized, Role: FOLLOWER
I20260808 17:45:17.851554 14062 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } }
I20260808 17:45:17.851802 14327 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } } }
I20260808 17:45:17.851845 14062 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:17.851908 14022 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 17:45:17.851919 14327 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:17.851995 14022 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:17.852804 14022 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } }
I20260808 17:45:17.853534 14256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "553c8f082ca240b9967ef94394a1768a"
I20260808 17:45:17.853667 14256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [term 0 FOLLOWER]: Advancing to term 1
W20260808 17:45:17.854038 14349 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:45:17.854162 14349 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:45:17.854549 14256 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1f93f9eb59242369f52f8c5b67d8a24 in term 1.
I20260808 17:45:17.854763 13977 leader_election.cc:302] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553c8f082ca240b9967ef94394a1768a, d1f93f9eb59242369f52f8c5b67d8a24; no voters:
I20260808 17:45:17.854879 14327 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:17.855050 14327 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [term 1 LEADER]: Becoming Leader. State: Replica: d1f93f9eb59242369f52f8c5b67d8a24, State: Running, Role: LEADER
I20260808 17:45:17.855127 14327 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } }
I20260808 17:45:17.855532 14327 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1f93f9eb59242369f52f8c5b67d8a24. Latest consensus state: current_term: 1 leader_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } } }
I20260808 17:45:17.855611 14327 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:17.855775 14022 leader_election.cc:288] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [CANDIDATE]: Term 1 election: Requested vote from peers a95c6cc5a0364cb19fc0bb060d058b63 (127.9.187.253:42271), 553c8f082ca240b9967ef94394a1768a (127.9.187.252:41687)
I20260808 17:45:17.854307 13943 master_runner.cc:186] Error getting master registration for 127.9.187.253:42271: OK, instance_id { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" instance_seqno: 1786211117649563 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:45:17.856467 13943 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:45:17.856845 14358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:17.857156 14358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:17.867015 14297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.858637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49892 (local address 127.9.187.252:41687)
0808 17:45:17.858671 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.858673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.859605 (+ 932us) server_negotiation.cc:407] Connection header received
0808 17:45:17.859702 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.859703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.859712 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.859739 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.860550 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.861236 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.862304 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.862598 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.862639 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.864148 (+ 1509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.864149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.864150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.864156 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.865756 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.866172 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.866173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.866174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.866237 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.866438 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.866438 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.866439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.866575 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.866649 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.866862 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.866933 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:45:17.868882 14187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.858403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39296 (local address 127.9.187.253:42271)
0808 17:45:17.858444 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.858446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.858813 (+ 367us) server_negotiation.cc:407] Connection header received
0808 17:45:17.858943 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.858944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.858954 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.858982 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.860189 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.860931 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.862488 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.863349 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.863394 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.865454 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.865456 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.865456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.865474 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.867289 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.867864 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.867865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.867865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.867938 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.868207 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.868208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.868209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.868340 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.868408 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.868709 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.868789 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:45:17.873090 14066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.858832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55996 (local address 127.9.187.254:34341)
0808 17:45:17.858863 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.858865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.866261 (+ 7396us) server_negotiation.cc:407] Connection header received
0808 17:45:17.866355 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.866356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.866366 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.866394 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.866964 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.867621 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.868455 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.868765 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.868825 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.870424 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.870425 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.870426 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.870433 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.871950 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.872325 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.872326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.872326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.872398 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.872584 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.872585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.872586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.872719 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.872820 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.872928 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.873001 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:45:17.877460 14256 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [term 1 FOLLOWER]: Refusing update from remote peer d1f93f9eb59242369f52f8c5b67d8a24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:45:17.877969 14355 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:45:17.879485 14301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1f93f9eb59242369f52f8c5b67d8a24. Latest consensus state: current_term: 1 leader_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } } }
I20260808 17:45:17.879586 14301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:17.881108 14355 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } } }
I20260808 17:45:17.881204 14355 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:17.881592 14182 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } attempt: 3
I20260808 17:45:17.881631 14368 mvcc.cc:205] Tried to move back new op lower bound from 7316320738823618560 to 7316320738735276032. Current Snapshot: MvccSnapshot[applied={T|T < 7316320738823618560}]
I20260808 17:45:17.881781 14372 mvcc.cc:205] Tried to move back new op lower bound from 7316320738823618560 to 7316320738735276032. Current Snapshot: MvccSnapshot[applied={T|T < 7316320738823618560}]
I20260808 17:45:17.881955 14301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } } }
I20260808 17:45:17.882050 14301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a [sys.catalog]: This master's current role is: FOLLOWER
Aug 08 17:45:17 dist-test-slave-bqcl krb5kdc[13910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211117, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
I20260808 17:45:17.886667 14358 catalog_manager.cc:1347] Generated new cluster ID: e7ff31b08f0c429b92699949a6b8ae31
I20260808 17:45:17.886711 14358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:17.889585 14184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.881836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:41687 (local address 127.0.0.1:49902)
0808 17:45:17.881936 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:17.881946 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:17.881986 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:17.882267 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:17.882268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:17.882425 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:17.882470 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.882472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.883343 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.883344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.884165 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:17.884168 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.884614 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.884615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:17.884691 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.885105 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:17.885110 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:17.886725 (+ 1615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:17.888443 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.888444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.888445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.888672 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.888910 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:17.888911 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:17.888911 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:17.888981 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:17.889283 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:17.889284 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:17.889340 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 17:45:17.889398 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 17:45:17.889489 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 17:45:17.889950 14297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:17.882059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49902 (local address 127.9.187.252:41687)
0808 17:45:17.882144 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.882146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.882153 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:45:17.882171 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.882172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.882180 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.882225 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.882543 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.883266 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.884245 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:17.884546 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:17.884610 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:17.886816 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:17.886817 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:17.886817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:17.886824 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:17.888337 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.888762 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.888763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.888763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.888832 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:17.889055 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:17.889056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:17.889056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:17.889186 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:17.889241 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:17.889795 (+ 554us) server_negotiation.cc:299] Negotiation successful
0808 17:45:17.889866 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 17:45:17.891310 14182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63: Bootstrap starting.
I20260808 17:45:17.891930 14182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:17.892194 14182 log.cc:824] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:17.910805 14182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63: No bootstrap required, opened a new log
I20260808 17:45:17.912776 14182 raft_consensus.cc:348] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } }
I20260808 17:45:17.912926 14182 raft_consensus.cc:729] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95c6cc5a0364cb19fc0bb060d058b63, State: Initialized, Role: FOLLOWER
I20260808 17:45:17.912999 14182 consensus_queue.cc:260] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } }
I20260808 17:45:17.913331 14182 sys_catalog.cc:564] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:17.913368 14132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a95c6cc5a0364cb19fc0bb060d058b63"
I20260808 17:45:17.913489 14132 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:17.916136 14132 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1f93f9eb59242369f52f8c5b67d8a24 in term 1.
I20260808 17:45:17.917447 14131 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [term 1 FOLLOWER]: Refusing update from remote peer d1f93f9eb59242369f52f8c5b67d8a24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:45:17.918038 14327 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:45:17.920116 14403 sys_catalog.cc:455] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1f93f9eb59242369f52f8c5b67d8a24. Latest consensus state: current_term: 1 leader_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } } }
I20260808 17:45:17.920234 14403 sys_catalog.cc:458] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:17.920203 14358 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:17.920349 14403 sys_catalog.cc:455] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } } }
I20260808 17:45:17.920470 14403 sys_catalog.cc:458] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:17.920928 14358 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:17.920929 14404 mvcc.cc:205] Tried to move back new op lower bound from 7316320738823618560 to 7316320738735276032. Current Snapshot: MvccSnapshot[applied={T|T < 7316320738823618560}]
I20260808 17:45:17.919961 14379 sys_catalog.cc:455] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } } }
I20260808 17:45:17.921264 14379 sys_catalog.cc:458] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:17.922873 14355 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1f93f9eb59242369f52f8c5b67d8a24" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 34341 } } peers { permanent_uuid: "a95c6cc5a0364cb19fc0bb060d058b63" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 42271 } } peers { permanent_uuid: "553c8f082ca240b9967ef94394a1768a" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 41687 } } }
I20260808 17:45:17.922955 14355 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24 [sys.catalog]: This master's current role is: LEADER
W20260808 17:45:17.924060 14407 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:45:17.924160 14407 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:45:17.931782 14358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1f93f9eb59242369f52f8c5b67d8a24: Generated new TSK 0
I20260808 17:45:17.931963 14358 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:45:17.963136 14187 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:17.961480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39306 (local address 127.9.187.253:42271)
0808 17:45:17.961524 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.961526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.962475 (+ 949us) server_negotiation.cc:407] Connection header received
0808 17:45:17.962576 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.962577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.962588 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.962630 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.963068 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39306: BlockingRecv error: recv got EOF from 127.0.0.1:39306 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 17:45:17.964284 14066 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:17.962201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56004 (local address 127.9.187.254:34341)
0808 17:45:17.962238 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.962240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.963638 (+ 1398us) server_negotiation.cc:407] Connection header received
0808 17:45:17.963778 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.963780 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.963789 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.963818 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.964220 (+ 402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56004: BlockingRecv error: recv got EOF from 127.0.0.1:56004 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 17:45:17.964887 14297 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:17.961871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49916 (local address 127.9.187.252:41687)
0808 17:45:17.961911 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.961913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.963505 (+ 1592us) server_negotiation.cc:407] Connection header received
0808 17:45:17.963879 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.963880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.963890 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.963917 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.964831 (+ 914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49916: BlockingRecv error: recv got EOF from 127.0.0.1:49916 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 17:45:17.967231 14187 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:17.966230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39314 (local address 127.9.187.253:42271)
0808 17:45:17.966264 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.966265 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.966750 (+ 485us) server_negotiation.cc:407] Connection header received
0808 17:45:17.966851 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.966852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.966869 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.966895 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.967186 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39314: BlockingRecv error: recv got EOF from 127.0.0.1:39314 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 17:45:17.970161 14187 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:17.969396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39320 (local address 127.9.187.253:42271)
0808 17:45:17.969428 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.969430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.969673 (+ 243us) server_negotiation.cc:407] Connection header received
0808 17:45:17.969762 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.969763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.969772 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.969801 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.970095 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39320: BlockingRecv error: recv got EOF from 127.0.0.1:39320 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 17:45:17.973996 14187 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:17.973259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39330 (local address 127.9.187.253:42271)
0808 17:45:17.973292 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.973293 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.973523 (+ 230us) server_negotiation.cc:407] Connection header received
0808 17:45:17.973624 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.973624 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.973634 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.973660 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.973956 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39330: BlockingRecv error: recv got EOF from 127.0.0.1:39330 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 17:45:17.979961 14187 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:17.979194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39346 (local address 127.9.187.253:42271)
0808 17:45:17.979227 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.979229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.979470 (+ 241us) server_negotiation.cc:407] Connection header received
0808 17:45:17.979558 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.979559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.979570 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.979609 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.979921 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39346: BlockingRecv error: recv got EOF from 127.0.0.1:39346 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 17:45:17.989847 14187 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:17.989074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39350 (local address 127.9.187.253:42271)
0808 17:45:17.989108 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:17.989110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:17.989345 (+ 235us) server_negotiation.cc:407] Connection header received
0808 17:45:17.989430 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:17.989431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:17.989441 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:17.989468 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:17.989799 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39350: BlockingRecv error: recv got EOF from 127.0.0.1:39350 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 17:45:18.008070 14187 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:18.007236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39364 (local address 127.9.187.253:42271)
0808 17:45:18.007281 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:18.007283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:18.007421 (+ 138us) server_negotiation.cc:407] Connection header received
0808 17:45:18.007544 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:18.007546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:18.007558 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:18.007589 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:18.008009 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39364: BlockingRecv error: recv got EOF from 127.0.0.1:39364 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 17:45:18.042232 14187 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:18.041546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39376 (local address 127.9.187.253:42271)
0808 17:45:18.041611 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:18.041614 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:18.041678 (+ 64us) server_negotiation.cc:407] Connection header received
0808 17:45:18.041743 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:18.041744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:18.041756 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:18.041804 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:18.042168 (+ 364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39376: BlockingRecv error: recv got EOF from 127.0.0.1:39376 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 17:45:18.108125 14187 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:18.107384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39382 (local address 127.9.187.253:42271)
0808 17:45:18.107480 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:18.107482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:18.107538 (+ 56us) server_negotiation.cc:407] Connection header received
0808 17:45:18.107603 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:18.107604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:18.107616 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:18.107669 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:18.108057 (+ 388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39382: BlockingRecv error: recv got EOF from 127.0.0.1:39382 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 17:45:18.237985 14187 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:18.237256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39388 (local address 127.9.187.253:42271)
0808 17:45:18.237336 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:18.237338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:18.237418 (+ 80us) server_negotiation.cc:407] Connection header received
0808 17:45:18.237488 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:18.237489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:18.237503 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:18.237560 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:18.237914 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39388: BlockingRecv error: recv got EOF from 127.0.0.1:39388 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 17:45:18.495715 14187 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:18.495139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39392 (local address 127.9.187.253:42271)
0808 17:45:18.495199 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:18.495201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:18.495212 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:45:18.495253 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:18.495254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:18.495265 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:18.495306 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:18.495648 (+ 342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39392: BlockingRecv error: recv got EOF from 127.0.0.1:39392 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 17:45:18.833495 14323 catalog_manager.cc:1259] Loaded cluster ID: e7ff31b08f0c429b92699949a6b8ae31
I20260808 17:45:18.833566 14323 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a: loading cluster ID for follower catalog manager: success
I20260808 17:45:18.834375 14323 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a: acquiring CA information for follower catalog manager: success
I20260808 17:45:18.834671 14323 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 553c8f082ca240b9967ef94394a1768a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:45:18.924685 14407 catalog_manager.cc:1259] Loaded cluster ID: e7ff31b08f0c429b92699949a6b8ae31
I20260808 17:45:18.924774 14407 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63: loading cluster ID for follower catalog manager: success
I20260808 17:45:18.925657 14407 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63: acquiring CA information for follower catalog manager: success
I20260808 17:45:18.925963 14407 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a95c6cc5a0364cb19fc0bb060d058b63: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:45:19.011471 14518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:19.008841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39400 (local address 127.9.187.253:42271)
0808 17:45:19.008962 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:19.008965 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:19.009004 (+ 39us) server_negotiation.cc:407] Connection header received
0808 17:45:19.009095 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:19.009096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:19.009162 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:19.009229 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:45:19.009373 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:19.009897 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:19.010694 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:19.010897 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:19.010952 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:19.011124 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:45:19.011244 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:45:19.011315 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:19.011354 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 17:45:19.011376 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":58,"threads_started":1}
I20260808 17:45:19.015796 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:19.013310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49918 (local address 127.9.187.252:41687)
0808 17:45:19.013431 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:19.013433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:19.013441 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:45:19.013481 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:19.013482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:19.013516 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:19.013589 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:45:19.013699 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:19.014305 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:19.015080 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:19.015284 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:19.015334 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:19.015466 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:45:19.015592 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:45:19.015656 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:19.015695 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 17:45:19.015715 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":55,"threads_started":1}
I20260808 17:45:19.020138 14546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:19.017343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56016 (local address 127.9.187.254:34341)
0808 17:45:19.017516 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:19.017518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:19.017526 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:45:19.017573 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:19.017573 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:19.017623 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:19.017704 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:45:19.017883 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:19.018617 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:19.019316 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:19.019586 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:19.019647 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:19.019833 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:45:19.019935 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:45:19.019992 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:19.020036 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 17:45:19.020057 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":60,"threads_started":1}
I20260808 17:45:19.020195 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:19.017538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49930 (local address 127.9.187.252:41687)
0808 17:45:19.017581 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:19.017583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:19.017627 (+ 44us) server_negotiation.cc:407] Connection header received
0808 17:45:19.017702 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:19.017703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:19.017713 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:19.017754 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:45:19.017858 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:19.018362 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:19.019459 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:19.019664 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:19.019722 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:19.019862 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:45:19.019892 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:45:19.019944 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:19.020106 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 17:45:19.020128 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:45:19.020295 14518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:19.017298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39410 (local address 127.9.187.253:42271)
0808 17:45:19.017441 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:19.017443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:19.017451 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:45:19.017474 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:19.017474 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:19.017482 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:19.017526 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:45:19.017680 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:19.018397 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:19.019453 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:19.019729 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:19.019789 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:19.019944 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:45:19.019974 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:45:19.020019 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:19.020200 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 17:45:19.020226 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260808 17:45:19.021934 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 13943
I20260808 17:45:19.036298 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 14072
I20260808 17:45:19.045020 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 14192
2026-08-08T17:45:19Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2930 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:45:19 dist-test-slave-bqcl krb5kdc[14553](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:45:19 dist-test-slave-bqcl krb5kdc[14553](info): set up 2 sockets
Aug 08 17:45:19 dist-test-slave-bqcl krb5kdc[14553](info): commencing operation
krb5kdc: starting...
W20260808 17:45:20.212428 9967 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/test-user.keytab.
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:45:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:45:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.187.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
Entry for principal kudu/127.9.187.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab.
I20260808 17:45:20.326869 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:43259
--webserver_interface=127.9.187.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:35569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:43259,127.9.187.253:45251,127.9.187.252:46645
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:45:20.406430 14572 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:45:20.406646 14572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:20.406661 14572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:20.406679 14572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:20.407747 14572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:20.407783 14572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:20.407795 14572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:20.407806 14572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:20.407817 14572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:20.409222 14572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:43259,127.9.187.253:45251,127.9.187.252:46645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.254.keytab
--principal=kudu/127.9.187.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.254:43259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.187.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:20.409412 14572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:20.409582 14572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:20.414296 14578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:20.414296 14583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:20.414497 14572 server_base.cc:1034] running on GCE node
W20260808 17:45:20.414587 14580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:20.414891 14572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:20.415189 14572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:20.416343 14572 hybrid_clock.cc:648] HybridClock initialized: now 1786211120416328 us; error 30 us; skew 500 ppm
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:20.418872 14572 init.cc:377] Logged in from keytab as kudu/127.9.187.254@KRBTEST.COM (short username kudu)
I20260808 17:45:20.419297 14572 webserver.cc:460] Webserver started at http://127.9.187.254:45777/ using document root <none> and password file <none>
I20260808 17:45:20.419497 14572 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:20.419549 14572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:20.419679 14572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:20.420691 14572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/data/instance:
uuid: "c88ba52156c147b2aacc18291c3f4f9c"
format_stamp: "Formatted at 2026-08-08 17:45:20 on dist-test-slave-bqcl"
server_key: "eea1edc047e8a95bb969bfcb0e9c5954"
server_key_iv: "b173f937129a1a7cbb084c5b089d18eb"
server_key_version: "encryptionkey@0"
I20260808 17:45:20.421053 14572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/wal/instance:
uuid: "c88ba52156c147b2aacc18291c3f4f9c"
format_stamp: "Formatted at 2026-08-08 17:45:20 on dist-test-slave-bqcl"
server_key: "eea1edc047e8a95bb969bfcb0e9c5954"
server_key_iv: "b173f937129a1a7cbb084c5b089d18eb"
server_key_version: "encryptionkey@0"
I20260808 17:45:20.422358 14572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:45:20.423045 14593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:20.423195 14572 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:45:20.423288 14572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/wal
uuid: "c88ba52156c147b2aacc18291c3f4f9c"
format_stamp: "Formatted at 2026-08-08 17:45:20 on dist-test-slave-bqcl"
server_key: "eea1edc047e8a95bb969bfcb0e9c5954"
server_key_iv: "b173f937129a1a7cbb084c5b089d18eb"
server_key_version: "encryptionkey@0"
I20260808 17:45:20.423353 14572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:20.440136 14572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:20.441932 14572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:20.442085 14572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:20.446322 14572 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.254:43259
I20260808 17:45:20.446364 14677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.254:43259 every 8 connection(s)
I20260808 17:45:20.446681 14572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/data/info.pb
I20260808 17:45:20.447643 14679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:20.449116 14679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:20.451249 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 14572
I20260808 17:45:20.451357 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-0/wal/instance
I20260808 17:45:20.451540 9967 external_mini_cluster.cc:1428] Setting key c48bc7ea6dc28371934395e124b6737e
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:45:20.458868 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.449737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:43259 (local address 127.0.0.1:34958)
0808 17:45:20.449929 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.449962 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:20.450479 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:20.450758 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:20.450760 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:20.451008 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:20.451192 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.451198 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.452308 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.452309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.453271 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.453274 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.453729 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.453730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.453793 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.454249 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:20.454257 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:20.455508 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:20.457446 (+ 1938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.457452 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.457454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.457644 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.457910 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.457910 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.457911 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.457978 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.458441 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:20.458447 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:20.458506 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 17:45:20.458599 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 17:45:20.458718 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":101,"threads_started":1}
I20260808 17:45:20.458933 14685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.449776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34958 (local address 127.9.187.254:43259)
0808 17:45:20.450213 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.450218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.450257 (+ 39us) server_negotiation.cc:407] Connection header received
0808 17:45:20.450651 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.450653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.450669 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.450745 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.451306 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.452211 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.453343 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.453641 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.453735 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.455615 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.455624 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.455625 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.455633 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.457359 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.457727 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.457730 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.457730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.457843 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.458032 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.458034 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.458034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.458351 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.458440 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.458658 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.458803 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":409,"thread_start_us":77,"threads_started":1}
I20260808 17:45:20.459558 14679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:20.459851 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.459754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45251 (local address 127.0.0.1:34776)
0808 17:45:20.459793 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.459833 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 17:45:20.459964 14596 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45251: connect: Connection refused (error 111)
I20260808 17:45:20.460335 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.460256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45251 (local address 127.0.0.1:34780)
0808 17:45:20.460290 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.460313 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
WARNING: no policy specified for kudu/127.9.187.253@KRBTEST.COM; defaulting to no policy
W20260808 17:45:20.460425 14679 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.253:45251: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45251: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab.
Entry for principal kudu/127.9.187.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab.
I20260808 17:45:20.476895 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.253:45251
--webserver_interface=127.9.187.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab
--principal=kudu/127.9.187.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:35569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:43259,127.9.187.253:45251,127.9.187.252:46645
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:45:20.509635 14679 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } attempt: 1
I20260808 17:45:20.510145 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.509987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45251 (local address 127.0.0.1:34784)
0808 17:45:20.510053 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.510087 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 17:45:20.510455 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.510372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45251 (local address 127.0.0.1:34792)
0808 17:45:20.510407 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.510432 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 17:45:20.510563 14679 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.253:45251: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45251: connect: Connection refused (error 111)
W20260808 17:45:20.559559 14692 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:45:20.559759 14692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:20.559777 14692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:20.559798 14692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:20.560837 14692 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:20.560874 14692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:20.560890 14692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:20.560904 14692 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:20.560915 14692 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:20.562382 14692 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:43259,127.9.187.253:45251,127.9.187.252:46645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.253.keytab
--principal=kudu/127.9.187.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.253:45251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.187.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:20.562574 14692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:20.562758 14692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:20.567240 14706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:20.567239 14702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:20.567263 14701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:20.567328 14692 server_base.cc:1034] running on GCE node
I20260808 17:45:20.567703 14692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:20.567981 14692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:20.569120 14692 hybrid_clock.cc:648] HybridClock initialized: now 1786211120569101 us; error 32 us; skew 500 ppm
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:20.571519 14692 init.cc:377] Logged in from keytab as kudu/127.9.187.253@KRBTEST.COM (short username kudu)
I20260808 17:45:20.571957 14692 webserver.cc:460] Webserver started at http://127.9.187.253:34821/ using document root <none> and password file <none>
I20260808 17:45:20.572170 14692 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:20.572217 14692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:20.572347 14692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:20.573311 14692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/data/instance:
uuid: "e79b6f630cb44d069b0abd6fa9bd5c68"
format_stamp: "Formatted at 2026-08-08 17:45:20 on dist-test-slave-bqcl"
server_key: "d276830b5e7fc415e9b90e383483bb57"
server_key_iv: "966d64a90e7bb0ed0e21a4dd96a25d95"
server_key_version: "encryptionkey@0"
I20260808 17:45:20.573648 14692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/wal/instance:
uuid: "e79b6f630cb44d069b0abd6fa9bd5c68"
format_stamp: "Formatted at 2026-08-08 17:45:20 on dist-test-slave-bqcl"
server_key: "d276830b5e7fc415e9b90e383483bb57"
server_key_iv: "966d64a90e7bb0ed0e21a4dd96a25d95"
server_key_version: "encryptionkey@0"
I20260808 17:45:20.574942 14692 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 17:45:20.575628 14723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:20.575793 14692 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:20.575874 14692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/wal
uuid: "e79b6f630cb44d069b0abd6fa9bd5c68"
format_stamp: "Formatted at 2026-08-08 17:45:20 on dist-test-slave-bqcl"
server_key: "d276830b5e7fc415e9b90e383483bb57"
server_key_iv: "966d64a90e7bb0ed0e21a4dd96a25d95"
server_key_version: "encryptionkey@0"
I20260808 17:45:20.575935 14692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:20.578694 14679 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } attempt: 2
I20260808 17:45:20.579080 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.578925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45251 (local address 127.0.0.1:34800)
0808 17:45:20.578990 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.579041 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 17:45:20.579443 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.579348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45251 (local address 127.0.0.1:34806)
0808 17:45:20.579390 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.579419 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:45:20.579524 14679 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.253:45251: Network error: Client connection negotiation failed: client connection to 127.9.187.253:45251: connect: Connection refused (error 111)
I20260808 17:45:20.595615 14692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:20.597306 14692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:20.597429 14692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:20.601186 14692 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.253:45251
I20260808 17:45:20.601219 14805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.253:45251 every 8 connection(s)
I20260808 17:45:20.601517 14692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/data/info.pb
I20260808 17:45:20.601882 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 14692
I20260808 17:45:20.601977 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-1/wal/instance
I20260808 17:45:20.602198 9967 external_mini_cluster.cc:1428] Setting key f85ca9217455ee3fc39324121ea9917d
I20260808 17:45:20.602533 14806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:20.603974 14806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.187.252@KRBTEST.COM; defaulting to no policy
I20260808 17:45:20.612596 14685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.604600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34966 (local address 127.9.187.254:43259)
0808 17:45:20.604656 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.604658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.604838 (+ 180us) server_negotiation.cc:407] Connection header received
0808 17:45:20.605285 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.605286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.605301 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.605359 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.605917 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.606667 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.607627 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.607935 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.608006 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.609890 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.609892 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.609892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.609900 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.611183 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.611603 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.611604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.611605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.611662 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.611955 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.611956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.611956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.612071 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.612124 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.612455 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.612530 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.187.252@KRBTEST.COM" created.
I20260808 17:45:20.612792 14809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.604569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:43259 (local address 127.0.0.1:34966)
0808 17:45:20.604711 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.604749 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:20.605192 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:20.605424 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:20.605427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:20.605655 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:20.605830 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.605834 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.606758 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.606759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.607540 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.607542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.608017 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.608018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.608118 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.608548 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:20.608556 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:20.609802 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:20.611274 (+ 1472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.611282 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.611284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.611516 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.611723 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.611723 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.611723 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.611884 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.612136 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:20.612143 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:20.612268 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 17:45:20.612363 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 17:45:20.612512 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":73,"threads_started":1}
I20260808 17:45:20.613533 14806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
I20260808 17:45:20.620926 14809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.613781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45251 (local address 127.0.0.1:34822)
0808 17:45:20.613828 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.613840 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:20.613891 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:20.614082 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:20.614083 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:20.614256 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:20.614314 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.614316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.615464 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.615465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.616204 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.616208 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.616649 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.616651 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.616727 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.617050 (+ 323us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:20.617054 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:20.618329 (+ 1275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:20.619909 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.619910 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.619911 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.620112 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.620291 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.620291 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.620292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.620357 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.620579 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:20.620580 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:20.620628 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 17:45:20.620707 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 17:45:20.620800 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 17:45:20.620951 14810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.613829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34822 (local address 127.9.187.253:45251)
0808 17:45:20.613962 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.613966 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.613980 (+ 14us) server_negotiation.cc:407] Connection header received
0808 17:45:20.613997 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.613999 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.614009 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.614068 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.614401 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.615385 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.616278 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.616572 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.616621 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.618411 (+ 1790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.618418 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.618418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.618424 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.619833 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.620190 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.620192 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.620192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.620240 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.620408 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.620409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.620409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.620522 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.620596 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.620729 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.620851 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260808 17:45:20.621551 14806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:20.621831 14809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.621738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47064)
0808 17:45:20.621768 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.621813 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 17:45:20.621959 14729 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
I20260808 17:45:20.622408 14809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.622334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47068)
0808 17:45:20.622359 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.622387 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260808 17:45:20.622503 14806 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:46645: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.187.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab.
Entry for principal kudu/127.9.187.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab.
I20260808 17:45:20.628140 9967 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskejXIA2/build/release/bin/kudu
/tmp/dist-test-taskejXIA2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.252:46645
--webserver_interface=127.9.187.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab
--principal=kudu/127.9.187.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.187.212:35569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.187.254:43259,127.9.187.253:45251,127.9.187.252:46645
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:45:20.670673 14679 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } attempt: 3
I20260808 17:45:20.671721 14806 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } attempt: 1
I20260808 17:45:20.672111 14809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.671980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47084)
0808 17:45:20.672029 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.672071 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 17:45:20.672456 14809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.672347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47098)
0808 17:45:20.672394 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.672427 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 17:45:20.672611 14806 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:46645: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
I20260808 17:45:20.677762 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.671042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45251 (local address 127.0.0.1:34838)
0808 17:45:20.671108 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.671120 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:20.671164 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:20.671312 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:20.671313 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:20.671478 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:20.671545 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.671546 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.672336 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.672337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.672977 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.672979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.673486 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.673487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.673553 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.673983 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:20.673987 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:20.675352 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:20.676888 (+ 1536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.676889 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.676890 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.677050 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.677227 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.677228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.677228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.677273 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.677507 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:20.677508 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:20.677549 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 17:45:20.677622 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 17:45:20.677695 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 17:45:20.677812 14810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.671123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34838 (local address 127.9.187.253:45251)
0808 17:45:20.671183 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.671185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.671196 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:45:20.671224 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.671225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.671242 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.671295 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.671625 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.672231 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.673057 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.673402 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.673479 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.675432 (+ 1953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.675433 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.675433 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.675441 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.676807 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.677114 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.677115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.677115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.677174 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.677319 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.677319 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.677320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.677443 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.677506 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.677655 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.677735 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 17:45:20.678171 14679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:20.678460 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.678372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47112)
0808 17:45:20.678403 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.678429 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260808 17:45:20.678761 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.678689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47126)
0808 17:45:20.678715 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.678738 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260808 17:45:20.678841 14679 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:46645: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
I20260808 17:45:20.709990 14679 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } attempt: 1
I20260808 17:45:20.710427 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.710306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47138)
0808 17:45:20.710362 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.710397 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 17:45:20.710773 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.710685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47152)
0808 17:45:20.710727 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.710752 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:45:20.710862 14679 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:46645: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
W20260808 17:45:20.711941 14814 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:45:20.712160 14814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:45:20.712194 14814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:45:20.712226 14814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:45:20.713349 14814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:45:20.713388 14814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:45:20.713406 14814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:45:20.713423 14814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:45:20.713447 14814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:45:20.714937 14814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.187.212:35569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.187.254:43259,127.9.187.253:45251,127.9.187.252:46645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/krb5kdc/kudu_127.9.187.252.keytab
--principal=kudu/127.9.187.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.187.252:46645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.187.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:45:20.715180 14814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:45:20.715394 14814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:45:20.719923 14824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:20.719933 14822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:45:20.719966 14827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:45:20.720115 14814 server_base.cc:1034] running on GCE node
I20260808 17:45:20.720363 14814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:45:20.720679 14814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:45:20.721837 14814 hybrid_clock.cc:648] HybridClock initialized: now 1786211120721818 us; error 38 us; skew 500 ppm
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:45:20.724383 14814 init.cc:377] Logged in from keytab as kudu/127.9.187.252@KRBTEST.COM (short username kudu)
I20260808 17:45:20.724824 14814 webserver.cc:460] Webserver started at http://127.9.187.252:36755/ using document root <none> and password file <none>
I20260808 17:45:20.725042 14814 fs_manager.cc:359] Metadata directory not provided
I20260808 17:45:20.725096 14814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:45:20.725231 14814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:45:20.726379 14814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/data/instance:
uuid: "7d64fed0bcc54a959ba6e4df2c867d27"
format_stamp: "Formatted at 2026-08-08 17:45:20 on dist-test-slave-bqcl"
server_key: "787d7253a4aa52e6e0c7da99f3ae2e3b"
server_key_iv: "4ffa5185e92023f4e9cb93332d3f66ca"
server_key_version: "encryptionkey@0"
I20260808 17:45:20.726748 14814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/wal/instance:
uuid: "7d64fed0bcc54a959ba6e4df2c867d27"
format_stamp: "Formatted at 2026-08-08 17:45:20 on dist-test-slave-bqcl"
server_key: "787d7253a4aa52e6e0c7da99f3ae2e3b"
server_key_iv: "4ffa5185e92023f4e9cb93332d3f66ca"
server_key_version: "encryptionkey@0"
I20260808 17:45:20.728051 14814 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:45:20.728768 14840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:45:20.728941 14814 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:45:20.729029 14814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/data,/tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/wal
uuid: "7d64fed0bcc54a959ba6e4df2c867d27"
format_stamp: "Formatted at 2026-08-08 17:45:20 on dist-test-slave-bqcl"
server_key: "787d7253a4aa52e6e0c7da99f3ae2e3b"
server_key_iv: "4ffa5185e92023f4e9cb93332d3f66ca"
server_key_version: "encryptionkey@0"
I20260808 17:45:20.729112 14814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:45:20.738396 14814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:45:20.740551 14814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:45:20.740698 14814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:45:20.740753 14806 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } attempt: 2
I20260808 17:45:20.741200 14809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.741030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47162)
0808 17:45:20.741118 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.741161 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 17:45:20.741607 14809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.741467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47174)
0808 17:45:20.741519 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.741584 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:45:20.741700 14806 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.187.252:46645: Network error: Client connection negotiation failed: client connection to 127.9.187.252:46645: connect: Connection refused (error 111)
I20260808 17:45:20.744831 14814 rpc_server.cc:307] RPC server started. Bound to: 127.9.187.252:46645
I20260808 17:45:20.744861 14933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.187.252:46645 every 8 connection(s)
I20260808 17:45:20.745191 14814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/data/info.pb
I20260808 17:45:20.746536 14934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:45:20.748025 14934 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:45:20.752708 9967 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskejXIA2/build/release/bin/kudu as pid 14814
I20260808 17:45:20.752802 9967 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskejXIA2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786210848752357-9967-0/minicluster-data/master-2/wal/instance
I20260808 17:45:20.753003 9967 external_mini_cluster.cc:1428] Setting key 525758798e8078cccaedf0b3d9840411
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
I20260808 17:45:20.756358 14685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.748724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34970 (local address 127.9.187.254:43259)
0808 17:45:20.748790 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.748793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.748962 (+ 169us) server_negotiation.cc:407] Connection header received
0808 17:45:20.749394 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.749396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.749406 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.749463 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.750005 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.750522 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.751421 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.751598 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.751650 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.753790 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.753792 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.753792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.753799 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.755061 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.755490 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.755491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.755491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.755579 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.755789 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.755790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.755790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.755921 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.755983 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.756192 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.756267 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 17:45:20.756532 14937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.748683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.254:43259 (local address 127.0.0.1:34970)
0808 17:45:20.748850 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.748889 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:20.749314 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:20.749520 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:20.749523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:20.749753 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:20.749932 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.749936 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.750596 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.750597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.751357 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.751359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.751699 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.751700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.751810 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.752220 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:20.752228 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:20.753701 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:20.755135 (+ 1434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.755141 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.755142 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.755409 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.755637 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.755637 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.755637 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.755734 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.755975 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:20.755978 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:20.756086 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 17:45:20.756161 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 17:45:20.756269 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260808 17:45:20.757009 14934 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
I20260808 17:45:20.761711 14942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.753381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47180 (local address 127.9.187.252:46645)
0808 17:45:20.753530 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.753535 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.753596 (+ 61us) server_negotiation.cc:407] Connection header received
0808 17:45:20.753636 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.753639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.753660 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.753746 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.754659 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.755406 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.756325 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.756740 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.756799 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.759281 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.759289 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.759289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.759296 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.760698 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.761003 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.761006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.761006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.761055 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.761225 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.761226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.761226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.761348 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.761468 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.761550 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.761621 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260808 17:45:20.763350 14937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.757214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.253:45251 (local address 127.0.0.1:34842)
0808 17:45:20.757310 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.757317 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:20.757355 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:20.757469 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:20.757470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:20.757573 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:20.757618 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.757619 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.758446 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.758447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.759180 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.759183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.759606 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.759607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.759677 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.759961 (+ 284us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:20.759964 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:20.760967 (+ 1003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:20.762497 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.762498 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.762498 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.762701 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.762865 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.762866 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.762866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.762909 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.763167 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:20.763168 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:20.763197 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 17:45:20.763238 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 17:45:20.763296 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 17:45:20.763408 14810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.757271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34842 (local address 127.9.187.253:45251)
0808 17:45:20.757321 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.757323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.757349 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:45:20.757395 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.757396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.757406 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.757467 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.757680 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.758380 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.759267 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.759546 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.759609 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.761039 (+ 1430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.761040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.761040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.761047 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.762430 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.762753 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.762754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.762754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.762824 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.762964 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.762965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.762965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.763103 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.763180 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.763264 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.763327 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:45:20.764233 14934 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.254@KRBTEST.COM
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.252@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
I20260808 17:45:20.769487 14685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.762625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34982 (local address 127.9.187.254:43259)
0808 17:45:20.762666 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.762668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.762676 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:45:20.762695 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.762696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.762705 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.762751 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.763390 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.763888 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.764774 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.764984 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.765029 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.767285 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.767286 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.767286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.767293 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.768566 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.768852 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.768853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.768853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.768905 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.769066 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.769067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.769067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.769169 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.769306 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.769343 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.769405 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:45:20.770555 14942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.764439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47186 (local address 127.9.187.252:46645)
0808 17:45:20.764469 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.764471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.764493 (+ 22us) server_negotiation.cc:407] Connection header received
0808 17:45:20.764557 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.764558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.764566 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.764606 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.764810 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.765357 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.766266 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.766511 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.766573 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.768223 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.768224 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.768224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.768230 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.769342 (+ 1112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.769748 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.769749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.769749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.769819 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.770006 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.770007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.770007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.770119 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.770207 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.770355 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.770455 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":14}
I20260808 17:45:20.770542 14937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.764414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47186)
0808 17:45:20.764452 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.764461 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:20.764503 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:20.764620 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:20.764621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:20.764720 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:20.764749 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.764750 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.765432 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.765433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.766196 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.766198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.766588 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.766589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.766629 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.766994 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:20.766998 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:20.768148 (+ 1150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:20.769413 (+ 1265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.769414 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.769415 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.769604 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.769879 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.769880 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.769880 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.769944 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.770213 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:20.770214 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:20.770258 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 17:45:20.770321 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 17:45:20.770410 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 17:45:20.771760 14934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27: Bootstrap starting.
I20260808 17:45:20.772619 14934 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:20.772892 14934 log.cc:824] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:20.773617 14934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27: No bootstrap required, opened a new log
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.187.253@KRBTEST.COM
I20260808 17:45:20.775528 14934 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } }
I20260808 17:45:20.775686 14934 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d64fed0bcc54a959ba6e4df2c867d27, State: Initialized, Role: FOLLOWER
I20260808 17:45:20.775771 14934 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } }
I20260808 17:45:20.776098 14934 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:20.776032 14944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } } }
I20260808 17:45:20.776168 14944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:20.777062 14810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.770050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34854 (local address 127.9.187.253:45251)
0808 17:45:20.770098 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.770099 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.770154 (+ 55us) server_negotiation.cc:407] Connection header received
0808 17:45:20.770244 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.770245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.770254 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.770290 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.770970 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.771403 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.772145 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.772356 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.772411 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.774602 (+ 2191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.774603 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.774604 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.774611 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.776004 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.776371 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.776372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.776373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.776432 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.776603 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.776604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.776605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.776716 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.776876 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.776911 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.776977 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 17:45:20.777817 14958 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:45:20.777869 14958 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:45:20.778713 9967 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:45:20.779677 14635 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c88ba52156c147b2aacc18291c3f4f9c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34982
I20260808 17:45:20.778184 14814 master_runner.cc:186] Error getting master registration for 127.9.187.254:43259: OK, instance_id { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" instance_seqno: 1786211120445076 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:45:20.780889 14814 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:45:20.785956 14679 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } attempt: 2
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.254@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
I20260808 17:45:20.793285 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.786223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47188)
0808 17:45:20.786274 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.786283 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:20.786321 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:20.786445 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:20.786446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:20.786627 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:20.786676 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.786678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.787571 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.787572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.788385 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.788387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.788814 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.788814 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.788872 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.789215 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:20.789220 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:20.790711 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:20.792289 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.792290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.792290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.792451 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.792625 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.792625 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.792626 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.792699 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.792976 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:20.792977 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:20.793023 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 17:45:20.793095 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 17:45:20.793191 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 17:45:20.793283 14942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.786290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47188 (local address 127.9.187.252:46645)
0808 17:45:20.786335 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.786337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.786344 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:45:20.786368 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.786368 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.786377 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.786424 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.786746 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.787500 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.788458 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.788754 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.788809 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.790788 (+ 1979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.790789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.790790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.790796 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.792221 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.792512 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.792513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.792513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.792577 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.792745 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.792745 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.792746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.792916 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.792974 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.793119 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.793191 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:45:20.794725 14679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c: Bootstrap starting.
I20260808 17:45:20.795358 14679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:20.795629 14679 log.cc:824] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:20.796317 14679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c: No bootstrap required, opened a new log
I20260808 17:45:20.797282 14679 raft_consensus.cc:348] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } }
I20260808 17:45:20.797395 14679 raft_consensus.cc:729] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c88ba52156c147b2aacc18291c3f4f9c, State: Initialized, Role: FOLLOWER
I20260808 17:45:20.797469 14679 consensus_queue.cc:260] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } }
I20260808 17:45:20.797719 14966 sys_catalog.cc:455] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } } }
I20260808 17:45:20.797780 14679 sys_catalog.cc:564] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:20.797803 14966 sys_catalog.cc:458] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:20.797896 14635 raft_consensus.cc:482] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 17:45:20.797979 14635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:20.798790 14635 raft_consensus.cc:504] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } }
W20260808 17:45:20.799494 14983 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:45:20.799575 14983 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:45:20.799695 14890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c88ba52156c147b2aacc18291c3f4f9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7d64fed0bcc54a959ba6e4df2c867d27"
I20260808 17:45:20.799819 14890 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:20.800663 14890 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c88ba52156c147b2aacc18291c3f4f9c in term 1.
I20260808 17:45:20.800951 14597 leader_election.cc:302] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d64fed0bcc54a959ba6e4df2c867d27, c88ba52156c147b2aacc18291c3f4f9c; no voters:
I20260808 17:45:20.801072 14966 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:45:20.801198 14966 raft_consensus.cc:686] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [term 1 LEADER]: Becoming Leader. State: Replica: c88ba52156c147b2aacc18291c3f4f9c, State: Running, Role: LEADER
I20260808 17:45:20.801275 14966 consensus_queue.cc:237] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } }
I20260808 17:45:20.801678 14966 sys_catalog.cc:455] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c88ba52156c147b2aacc18291c3f4f9c. Latest consensus state: current_term: 1 leader_uuid: "c88ba52156c147b2aacc18291c3f4f9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } } }
I20260808 17:45:20.801769 14966 sys_catalog.cc:458] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:20.802274 14635 leader_election.cc:288] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [CANDIDATE]: Term 1 election: Requested vote from peers e79b6f630cb44d069b0abd6fa9bd5c68 (127.9.187.253:45251), 7d64fed0bcc54a959ba6e4df2c867d27 (127.9.187.252:46645)
I20260808 17:45:20.800448 14572 master_runner.cc:186] Error getting master registration for 127.9.187.253:45251: OK, instance_id { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" instance_seqno: 1786211120600160 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:45:20.802716 14572 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:45:20.804226 14988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:45:20.805141 14988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:45:20.812103 14685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.803434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34992 (local address 127.9.187.254:43259)
0808 17:45:20.803483 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.803485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.803881 (+ 396us) server_negotiation.cc:407] Connection header received
0808 17:45:20.803980 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.803980 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.803990 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.804019 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.804858 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.805605 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.806716 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.807002 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.807043 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.808572 (+ 1529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.808574 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.808574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.808581 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.810356 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.810948 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.810949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.810950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.811007 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.811400 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.811401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.811401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.811550 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.811632 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.811940 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.812013 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:45:20.815583 14942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.803534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47194 (local address 127.9.187.252:46645)
0808 17:45:20.803568 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.803570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.807426 (+ 3856us) server_negotiation.cc:407] Connection header received
0808 17:45:20.807545 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.807546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.807557 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.807598 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.809091 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.809793 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.810796 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.811083 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.811123 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.812453 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.812455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.812455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.812462 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.814424 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.814805 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.814807 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.814807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.814860 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.815039 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.815040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.815040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.815153 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.815218 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.815409 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.815479 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:45:20.817621 14890 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [term 1 FOLLOWER]: Refusing update from remote peer c88ba52156c147b2aacc18291c3f4f9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:45:20.817975 14985 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:45:20.819835 14944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c88ba52156c147b2aacc18291c3f4f9c. Latest consensus state: current_term: 1 leader_uuid: "c88ba52156c147b2aacc18291c3f4f9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } } }
I20260808 17:45:20.819926 14944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:20.821164 14810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.804142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34864 (local address 127.9.187.253:45251)
0808 17:45:20.804188 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.804190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.812687 (+ 8497us) server_negotiation.cc:407] Connection header received
0808 17:45:20.812810 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.812811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.812833 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.812861 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.813634 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.814384 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.815797 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.816104 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.816143 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.817997 (+ 1854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.817999 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.817999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.818018 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.819571 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.820139 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.820140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.820141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.820211 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.820482 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.820483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.820484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.820627 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.820705 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.820994 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.821072 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:45:20.827152 14985 sys_catalog.cc:455] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c88ba52156c147b2aacc18291c3f4f9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } } }
I20260808 17:45:20.827234 14985 sys_catalog.cc:458] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:20.827279 15000 mvcc.cc:205] Tried to move back new op lower bound from 7316320750866419712 to 7316320750802653184. Current Snapshot: MvccSnapshot[applied={T|T < 7316320750866419712}]
I20260808 17:45:20.827445 14944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c88ba52156c147b2aacc18291c3f4f9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } } }
I20260808 17:45:20.827513 14944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:20.827996 15001 mvcc.cc:205] Tried to move back new op lower bound from 7316320750866419712 to 7316320750802653184. Current Snapshot: MvccSnapshot[applied={T|T < 7316320750866419712}]
I20260808 17:45:20.828091 14988 catalog_manager.cc:1347] Generated new cluster ID: 1ce51787235b4ddc8b3d075a182da975
I20260808 17:45:20.828137 14988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:45:20.832819 14806 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } attempt: 3
Aug 08 17:45:20 dist-test-slave-bqcl krb5kdc[14553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211120, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.187.253@KRBTEST.COM for kudu/127.9.187.252@KRBTEST.COM
I20260808 17:45:20.840936 14809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.833054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.187.252:46645 (local address 127.0.0.1:47198)
0808 17:45:20.833130 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0808 17:45:20.833140 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:45:20.833173 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:45:20.833432 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:45:20.833433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:45:20.833598 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:45:20.833638 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.833640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.834530 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.834531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.835349 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:45:20.835351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.835887 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.835888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:45:20.835963 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.836405 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:45:20.836422 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:45:20.837904 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:45:20.839836 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.839837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.839838 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.840047 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.840271 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:45:20.840272 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:45:20.840272 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:45:20.840339 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:45:20.840638 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:45:20.840639 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:45:20.840693 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 17:45:20.840750 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 17:45:20.840839 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 17:45:20.841382 14942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:20.833258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47198 (local address 127.9.187.252:46645)
0808 17:45:20.833290 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.833292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.833298 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:45:20.833315 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.833316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.833323 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.833364 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.833716 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.834429 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.835455 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:20.835769 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:20.835825 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:20.838001 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:45:20.838003 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:45:20.838003 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:45:20.838009 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:45:20.839735 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.840131 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.840132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.840132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.840199 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:45:20.840408 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:45:20.840409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:45:20.840409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:45:20.840539 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:45:20.840601 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:20.841224 (+ 623us) server_negotiation.cc:299] Negotiation successful
0808 17:45:20.841296 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:45:20.843058 14806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68: Bootstrap starting.
I20260808 17:45:20.843758 14806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68: Neither blocks nor log segments found. Creating new log.
I20260808 17:45:20.844039 14806 log.cc:824] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68: Log is configured to *not* fsync() on all Append() calls
I20260808 17:45:20.850767 14806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68: No bootstrap required, opened a new log
I20260808 17:45:20.852754 14806 raft_consensus.cc:348] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } }
I20260808 17:45:20.852885 14806 raft_consensus.cc:729] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e79b6f630cb44d069b0abd6fa9bd5c68, State: Initialized, Role: FOLLOWER
I20260808 17:45:20.852955 14806 consensus_queue.cc:260] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } }
I20260808 17:45:20.853267 14806 sys_catalog.cc:564] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:45:20.853296 14762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c88ba52156c147b2aacc18291c3f4f9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68"
I20260808 17:45:20.853415 14762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:45:20.854297 14762 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c88ba52156c147b2aacc18291c3f4f9c in term 1.
I20260808 17:45:20.854744 14761 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [term 1 FOLLOWER]: Refusing update from remote peer c88ba52156c147b2aacc18291c3f4f9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:45:20.855003 14966 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:45:20.855693 14988 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:45:20.856398 14988 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:45:20.856463 15008 sys_catalog.cc:455] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } } }
I20260808 17:45:20.856638 15008 sys_catalog.cc:458] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:20.856771 15008 sys_catalog.cc:455] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c88ba52156c147b2aacc18291c3f4f9c. Latest consensus state: current_term: 1 leader_uuid: "c88ba52156c147b2aacc18291c3f4f9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } } }
I20260808 17:45:20.856877 15008 sys_catalog.cc:458] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:20.856947 15008 sys_catalog.cc:455] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c88ba52156c147b2aacc18291c3f4f9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } } }
I20260808 17:45:20.857033 15008 sys_catalog.cc:458] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:45:20.857790 14985 sys_catalog.cc:455] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c88ba52156c147b2aacc18291c3f4f9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c88ba52156c147b2aacc18291c3f4f9c" member_type: VOTER last_known_addr { host: "127.9.187.254" port: 43259 } } peers { permanent_uuid: "e79b6f630cb44d069b0abd6fa9bd5c68" member_type: VOTER last_known_addr { host: "127.9.187.253" port: 45251 } } peers { permanent_uuid: "7d64fed0bcc54a959ba6e4df2c867d27" member_type: VOTER last_known_addr { host: "127.9.187.252" port: 46645 } } }
I20260808 17:45:20.857873 14985 sys_catalog.cc:458] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c [sys.catalog]: This master's current role is: LEADER
I20260808 17:45:20.859987 15029 mvcc.cc:205] Tried to move back new op lower bound from 7316320751019491328 to 7316320750802653184. Current Snapshot: MvccSnapshot[applied={T|T < 7316320750866419712}]
W20260808 17:45:20.862720 15042 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:45:20.862819 15042 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:45:20.865056 14988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c88ba52156c147b2aacc18291c3f4f9c: Generated new TSK 0
I20260808 17:45:20.865221 14988 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:45:20.888549 14942 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:20.887012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47206 (local address 127.9.187.252:46645)
0808 17:45:20.887051 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.887053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.887942 (+ 889us) server_negotiation.cc:407] Connection header received
0808 17:45:20.888035 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.888036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.888047 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.888075 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.888473 (+ 398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47206: BlockingRecv error: recv got EOF from 127.0.0.1:47206 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 17:45:20.889411 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:20.887374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34866 (local address 127.9.187.253:45251)
0808 17:45:20.887410 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.887412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.888928 (+ 1516us) server_negotiation.cc:407] Connection header received
0808 17:45:20.889016 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.889017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.889027 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.889051 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.889354 (+ 303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34866: BlockingRecv error: recv got EOF from 127.0.0.1:34866 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 17:45:20.890242 14685 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:20.887680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35004 (local address 127.9.187.254:43259)
0808 17:45:20.887715 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.887717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.889751 (+ 2034us) server_negotiation.cc:407] Connection header received
0808 17:45:20.889840 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.889841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.889851 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.889877 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.890185 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35004: BlockingRecv error: recv got EOF from 127.0.0.1:35004 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 17:45:20.895486 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:20.894738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34870 (local address 127.9.187.253:45251)
0808 17:45:20.894772 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.894773 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.894982 (+ 209us) server_negotiation.cc:407] Connection header received
0808 17:45:20.895085 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.895086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.895104 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.895131 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.895443 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34870: BlockingRecv error: recv got EOF from 127.0.0.1:34870 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 17:45:20.898555 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:20.897818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34872 (local address 127.9.187.253:45251)
0808 17:45:20.897849 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.897851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.898060 (+ 209us) server_negotiation.cc:407] Connection header received
0808 17:45:20.898177 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.898178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.898188 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.898215 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.898514 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34872: BlockingRecv error: recv got EOF from 127.0.0.1:34872 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 17:45:20.902474 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:20.901716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34882 (local address 127.9.187.253:45251)
0808 17:45:20.901749 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.901751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.901947 (+ 196us) server_negotiation.cc:407] Connection header received
0808 17:45:20.902036 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.902037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.902046 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.902073 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.902436 (+ 363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34882: BlockingRecv error: recv got EOF from 127.0.0.1:34882 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 17:45:20.908345 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:20.907614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34896 (local address 127.9.187.253:45251)
0808 17:45:20.907647 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.907649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.907877 (+ 228us) server_negotiation.cc:407] Connection header received
0808 17:45:20.907968 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.907969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.907978 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.908005 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.908305 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34896: BlockingRecv error: recv got EOF from 127.0.0.1:34896 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 17:45:20.918525 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:20.917611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34908 (local address 127.9.187.253:45251)
0808 17:45:20.917645 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.917646 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.917888 (+ 242us) server_negotiation.cc:407] Connection header received
0808 17:45:20.917983 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.917984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.917994 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.918022 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.918450 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34908: BlockingRecv error: recv got EOF from 127.0.0.1:34908 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 17:45:20.936838 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:20.935932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34910 (local address 127.9.187.253:45251)
0808 17:45:20.935975 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.935976 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.936245 (+ 269us) server_negotiation.cc:407] Connection header received
0808 17:45:20.936346 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.936347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.936359 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.936387 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.936782 (+ 395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34910: BlockingRecv error: recv got EOF from 127.0.0.1:34910 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 17:45:20.971151 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:20.970406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34914 (local address 127.9.187.253:45251)
0808 17:45:20.970460 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:20.970462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:20.970552 (+ 90us) server_negotiation.cc:407] Connection header received
0808 17:45:20.970610 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:20.970611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:20.970624 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:20.970707 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:20.971086 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34914: BlockingRecv error: recv got EOF from 127.0.0.1:34914 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 17:45:21.036955 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:21.036266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34930 (local address 127.9.187.253:45251)
0808 17:45:21.036344 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:21.036347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:21.036413 (+ 66us) server_negotiation.cc:407] Connection header received
0808 17:45:21.036490 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:21.036491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:21.036502 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:21.036559 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:21.036889 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34930: BlockingRecv error: recv got EOF from 127.0.0.1:34930 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 17:45:21.166754 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:21.166032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34936 (local address 127.9.187.253:45251)
0808 17:45:21.166109 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:21.166111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:21.166191 (+ 80us) server_negotiation.cc:407] Connection header received
0808 17:45:21.166238 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:21.166239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:21.166252 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:21.166326 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:21.166689 (+ 363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34936: BlockingRecv error: recv got EOF from 127.0.0.1:34936 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 17:45:21.424592 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:45:21.423958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34952 (local address 127.9.187.253:45251)
0808 17:45:21.424032 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:21.424034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:21.424075 (+ 41us) server_negotiation.cc:407] Connection header received
0808 17:45:21.424132 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:21.424132 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:21.424150 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:21.424214 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:45:21.424538 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34952: BlockingRecv error: recv got EOF from 127.0.0.1:34952 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 17:45:21.778358 14958 catalog_manager.cc:1259] Loaded cluster ID: 1ce51787235b4ddc8b3d075a182da975
I20260808 17:45:21.778434 14958 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27: loading cluster ID for follower catalog manager: success
I20260808 17:45:21.779286 14958 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27: acquiring CA information for follower catalog manager: success
I20260808 17:45:21.779606 14958 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7d64fed0bcc54a959ba6e4df2c867d27: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:45:21.863318 15042 catalog_manager.cc:1259] Loaded cluster ID: 1ce51787235b4ddc8b3d075a182da975
I20260808 17:45:21.863404 15042 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68: loading cluster ID for follower catalog manager: success
I20260808 17:45:21.864229 15042 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68: acquiring CA information for follower catalog manager: success
I20260808 17:45:21.864527 15042 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e79b6f630cb44d069b0abd6fa9bd5c68: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:45:21.940395 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:21.937880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34956 (local address 127.9.187.253:45251)
0808 17:45:21.938002 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:21.938004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:21.938015 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:45:21.938081 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:21.938082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:21.938166 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:21.938236 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:45:21.938399 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:21.938899 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:21.939649 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:21.939846 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:21.939902 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:21.940059 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:45:21.940174 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:45:21.940243 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:21.940282 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 17:45:21.940302 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":57,"threads_started":1}
I20260808 17:45:21.944445 15171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:21.942009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47216 (local address 127.9.187.252:46645)
0808 17:45:21.942160 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:21.942163 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:21.942201 (+ 38us) server_negotiation.cc:407] Connection header received
0808 17:45:21.942244 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:21.942245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:21.942282 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:21.942345 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:45:21.942418 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:21.942929 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:21.943726 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:21.943970 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:21.944040 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:21.944173 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:45:21.944275 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:45:21.944328 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:21.944344 (+ 16us) server_negotiation.cc:299] Negotiation successful
0808 17:45:21.944363 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":53,"threads_started":1}
I20260808 17:45:21.948832 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:21.945999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34970 (local address 127.9.187.253:45251)
0808 17:45:21.946045 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:21.946046 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:21.946164 (+ 118us) server_negotiation.cc:407] Connection header received
0808 17:45:21.946256 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:21.946257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:21.946266 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:21.946291 (+ 25us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:45:21.946426 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:21.947014 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:21.947933 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:21.948227 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:21.948267 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:21.948457 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:45:21.948492 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:45:21.948563 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:21.948735 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 17:45:21.948757 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:45:21.948930 15171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:21.946242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47220 (local address 127.9.187.252:46645)
0808 17:45:21.946288 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:21.946290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:21.946325 (+ 35us) server_negotiation.cc:407] Connection header received
0808 17:45:21.946402 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:21.946402 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:21.946414 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:21.946473 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:45:21.946566 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:21.947233 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:21.948214 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:21.948477 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:21.948560 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:21.948678 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:45:21.948709 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:45:21.948758 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:21.948849 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 17:45:21.948874 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:45:21.949261 15183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:45:21.946028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35016 (local address 127.9.187.254:43259)
0808 17:45:21.946151 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 17:45:21.946153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:45:21.946579 (+ 426us) server_negotiation.cc:407] Connection header received
0808 17:45:21.946631 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:45:21.946632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:45:21.946684 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:45:21.946778 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:45:21.946886 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:21.947548 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:21.948298 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:45:21.948602 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:45:21.948660 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:45:21.948884 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:45:21.949014 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:45:21.949079 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:45:21.949142 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 17:45:21.949171 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":54,"threads_started":1}
I20260808 17:45:21.950922 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 14572
I20260808 17:45:21.961161 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 14692
I20260808 17:45:21.971814 9967 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskejXIA2/build/release/bin/kudu with pid 14814
2026-08-08T17:45:21Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2924 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5854 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (273223 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST